Sakana AI

company

Verified

https://sakana.ai/

SakanaAI

AI & ML interests

We are a Tokyo-based R&D company on a quest to create a new kind of foundational AI model based on nature-inspired intelligence.

Recent Activity

yuki-imajuku updated a dataset about 3 hours ago

SakanaAI/ALE-Bench

yuki-imajuku published a dataset 2 days ago

SakanaAI/ALE-Bench

conglu authored a paper about 1 month ago

The Edge-of-Reach Problem in Offline Model-Based Reinforcement Learning

View all activity

SakanaAI's activity

yuki-imajuku

updated a dataset about 3 hours ago

SakanaAI/ALE-Bench

Updated about 6 hours ago • 4.58k • 1

yuki-imajuku

published a dataset 2 days ago

SakanaAI/ALE-Bench

Updated about 6 hours ago • 4.58k • 1

conglu

authored 2 papers about 1 month ago

The Edge-of-Reach Problem in Offline Model-Based Reinforcement Learning

Paper • 2402.12527 • Published Feb 19, 2024

The AI Scientist-v2: Workshop-Level Automated Scientific Discovery via Agentic Tree Search

Paper • 2504.08066 • Published Apr 10 • 11

yuki-imajuku

updated a model about 1 month ago

SakanaAI/Metom

Updated Apr 14 • 15 • 2

Taishi-N324

authored a paper about 1 month ago

Building Instruction-Tuning Datasets from Human-Written Instructions with Open-Weight Large Language Models

Paper • 2503.23714 • Published Mar 31

Taishi-N324

authored 3 papers 2 months ago

Balancing Speed and Stability: The Trade-offs of FP8 vs. BF16 Training in LLMs

Paper • 2411.08719 • Published Nov 10, 2024

Why We Build Local Large Language Models: An Observational Analysis from 35 Japanese and Multilingual LLMs

Paper • 2412.14471 • Published Dec 19, 2024

Wider or Deeper? Scaling LLM Inference-Time Compute with Adaptive Branching Tree Search

Paper • 2503.04412 • Published Mar 6 • 1

iwiwi

authored a paper 2 months ago

Wider or Deeper? Scaling LLM Inference-Time Compute with Adaptive Branching Tree Search

Paper • 2503.04412 • Published Mar 6 • 1

iwiwi

authored a paper 3 months ago

Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initialization

Paper • 2502.19261 • Published Feb 26 • 7

Taishi-N324

authored a paper 3 months ago

Drop-Upcycling: Training Sparse Mixture of Experts with Partial Re-initialization

Paper • 2502.19261 • Published Feb 26 • 7

takkyu2

authored a paper 4 months ago

TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models

Paper • 2501.16937 • Published Jan 28 • 6

iwiwi

authored a paper 4 months ago

TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models

Paper • 2501.16937 • Published Jan 28 • 6

mkshing

authored 2 papers 4 months ago

Release of Pre-Trained Models for the Japanese Language

Paper • 2404.01657 • Published Apr 2, 2024 • 1

TAID: Temporally Adaptive Interpolated Distillation for Efficient Knowledge Transfer in Language Models

Paper • 2501.16937 • Published Jan 28 • 6

lfsm

authored a paper 4 months ago

$\text{Transformer}^2$: Self-adaptive LLMs

Paper • 2501.06252 • Published Jan 9 • 55

tyj2022

authored 3 papers 4 months ago

$\text{Transformer}^2$: Self-adaptive LLMs

Paper • 2501.06252 • Published Jan 9 • 55

Agent Skill Acquisition for Large Language Models via CycleQD

Paper • 2410.14735 • Published Oct 16, 2024 • 2

An Evolved Universal Transformer Memory

Paper • 2410.13166 • Published Oct 17, 2024 • 4