Fractile is building chips to run large language models two orders of magnitude faster. Existing hardware is good for training LLMs, but very poorly suited to subsequent inference of the trained model, which is increasingly the dominant workload. A network’s weights need to be moved onto a chip once per word generated, and this movement takes a few hundred times longer than the subsequent computations themselves. Fractile’s revolutionary approach to fusing computation with memory eliminates this bottleneck, and can scale to allow running the world’s largest models at a global scale.

Semiconductor

Fractile

Fractile's headquarters in London, United Kingdom

This department is responsible for ensuring the accuracy and reliability of designs through various verification processes.

Verification Engineering

This department focuses on advancing technical projects and solutions within the organization.

Technical Staff

This department focuses on the development and implementation of design processes and methodologies for various engineering projects.

Design Engineering

This department focuses on the design and development of digital hardware and silicon components.

Silicon Engineering

This department focuses on designing, developing, and maintaining software applications.

Software Development

This department focuses on engineering solutions, including performance modeling and component design.

People (7)

Jobs (0)

Other teams

Technical Staff

Design Engineering

Silicon Engineering

Software Development

Engineering Services