Computational tools for studying complex biological systems

The lab of Talmo Pereira at the Salk Institute for Biological Studies builds deep learning and computer vision methods to capture biological motion, phenotype animals and plants at scale, and emulate living systems in simulation.

Led by
Talmo Pereira
Institute
Salk Institute for Biological Studies
La Jolla, California
Founded
2021
People
18 in the lab, 48 alumni
Software
Open source, on GitHub

Research

All research
  1. a Biological motion capture Pose estimation, identity tracking and 3D: from video to how every animal in it moves.
  2. b Phenoinformatics Systems for phenotyping at scale, from home cages recorded around the clock to the roots of crop plants.
  3. Rendered body models of a hooded rat, a fruit fly, a stick insect, a translucent green C. elegans worm and a mouse forelimb with red muscles, posed on a blue checkered arena against black.
    c Virtual biology Computational models that emulate biological systems closely enough to run experiments in simulation.

Recent publications

Papers, preprints and proceedings. A preprint that was later published is listed once.

All 40 publications

People

Scientists, engineers and students from neuroscience, computer science, biology and beyond: 18 people in the lab today, and 48 alumni.

Meet the team
Members of the lab, many in flannel shirts, standing and sitting in two rows on a concrete terrace at the Salk Institute.
The lab, ca. 2024. Photo credit: Chris Keeney.

Software

Open-source tools we build and maintain, starting with SLEAP for multi-animal pose tracking.

All tools
  • SLEAP A deep learning framework for multi-animal pose tracking.
  • sleap-nn The neural network backend for training and inference, split out of SLEAP so the models can be developed and used independently of the labelling GUI.
  • sleap-io Standalone utilities for reading, writing and converting pose tracking data.
  • sleap-app A web-based labelling GUI for SLEAP, running in the browser rather than as a desktop install.
  • DREEM DREEM Relates Every Entity's Motion — global tracking that links detections into identities across a whole video rather than frame to frame.

Join us

We place a high value on mentorship, work-life balance and open communication, and we recruit at every level: engineers, postdocs, graduate students and interns.

Opportunities talmo@salk.edu