Weekly AI/ML & Biotech Digest — Aug 17 to Aug 23, 2026
It have been quite a busy time since a recent family visiting trip. I only get a chance to read a few articles in the past week. Here is one that seems interesting. ★ Megalodon: Efficient LLM Pretraining and Inference with Unlimited Context Length — The quadratic complexity and weak length extrapolation of Transformers limits their ability to scale to long sequences, and while sub-quadratic solutions like linear attention and state space models exist, they empirically underperform Transformers in pretraining efficiency and downstream task accuracy. Another interesting article on synthetic biology, where researchers created a synthetic cell that puts user closer to building life from scratch. Here is a comment article from Science .