Biocurious is a weblog about biology, quantified.

TAGC Automated Tracking for Quantitative Phenotyping Workshop: Summary and Themes

by Andre on 18 July 2016

The workshop presenters, in order of appearance:

Harold Burgess, NIH

Megan Carey, Champalimaud

Gordon Berman, Emory

Ben de Bivort, Harvard

The goal of the workshop was to bring together researchers from different model organism communities who are working on tracking to do quantitative phenotyping. Niko Tinbergen defined behaviour as “the total movements made by the intact animal” in 1955 (review here), but this definition doesn’t tell us directly how animal movement should be measured, nor which aspects to focus on. Now is an interesting time to revisit these basic ethological questions in light of exciting progress in imaging and computer vision. Each model species has some idiosyncrasies but there are several challenges that are shared by us all and these emerged as themes of the workshop in the presentations and discussion afterwards. Here is my view of a few of these:

Tracking and dimensionality reduction
All of the workshop participants use some form of dimensionality reduction in their representations of animal behaviour. For me, this has been either based on PCA of worm shapes (Stephens et al.) or a direct discretisation into a set of template postures (Schwarz et al.), followed by a search for behavioural motifs (Brown et al. and Gomez-Marin et al.). Zebrafish larvae show bursty behaviour with fairly distinct starts and ends (part of a rich behavioural repertoire [pdf]). Harry uses the kinematics of these bouts to classify them into different kinds of locomotion (Burgess et al.) which can then be used to understand how fish phototax (Fernandes et al.) or perform escape manoeuvres when startled (Yokogawa et al.).

For limbed animals like flies, detailed tracking of body parts remains challenging. Gordon gets around this by directly analysing pixel values in movies followed by a couple of steps of dimensionality reduction (first on the pixel values and then on their variation). The resulting map of adult fly behaviour space shows clear evidence of stereotypy and has made it possible to analyse the structure of fly behaviour by looking at the transitions between stereotyped states (Berman et al.). Ben has also studied the walking of adult flies in detail, but using fluorescent particles to tag and track the legs (Kain et al.). He has also recently done an extensive study of unsupervised methods to find stereotyped patterns in this data (Todd et al.). Megan uses an SVM coupled to temporal information to accurately track the paws, tail, and nose of mice. Using a mirror they collect both a side and bottom view of the mice from a single camera (Machado et al.). Precise tracking of multiple points was essential for their studies of uncoordination in pcd mutants (more on that below). They’ve now added a (transparent!) split treadmill system (each side of the mouse needs to move at a different speed) to study how they respond to perturbation and how they learn to compensate, or not.

Finally, as Ben nicely illustrated in his work on flies in Y-mazes, sometimes low resolution is fine and can allow for much higher throughput. Collecting truly massive datasets (over 100 million decisions recorded so far!) has allowed them to look in detail at variability in behaviour which they’ve recently published in two papers focussing on the neural and genetic mechanisms (Buchanan et al. and Ayroles et al.).

Handling large data sets
Everyone is processing large video streams and using different approaches to deal with the data. Harry takes perhaps the most efficient approach and processes larval body shape in real-time so that the volume of data actually saved to disk is relatively small (just a few angles rather than millions of pixel intensities). This is similar to the approach taken in Swierczek et al. for worm tracking. This is especially important for fish, since they’re recording at 500-1000 fps when looking at the detailed kinematics of the tail. For some high-resolution experiments, following a single animal with a motorised stage makes it possible to record behaviour in a large area without a large field of view. This is something both Gordon (Berman et al) and I (Yemini et al.) talked about briefly. Megan reported two variations of restricted locomotion, one in which mice walk along a short track for imaging (Machado et al.) and the other using a treadmill. Ben has immobilised flies and allowed them to crawl on a floating ball, basically a treadmill for flies (Kain et al.).

We are currently taking a slightly different approach where we record multiple individuals in a large field of view, but zero the background around the worms. We can thus keep high-fidelity images of the worms for later analysis or manual review, while greatly reducing the volume of data that needs to be saved. You can see the current version and progress on Avelino Javer’s GitHub page.

Multidimensional phenotyping and being surprised by your data
One of the clearest illustrations of the importance of collecting multiple independent dimensions of behaviour came from Megan’s talk. When trying to understand how pcd mice differ from the wild type, they found that they were slower and smaller, raising the possibility that this was the main kind of difference between them. But, by using a careful characterisation of the wild type speed and size relationship, they were able to show that the pcd mice were not simply on a different part of the speed/size curve, but were indeed uncoordinated. Other places where multiple independent behavioural dimensions were critical was in Harry’s use of multiple kinematic features to classify fish behaviours.

Having a multidimensional view of behaviour is also great for using unsupervised approaches to behaviour analysis. Gordon summed up the usefulness of this as giving you the ability to be surprised by your data, a bit like a forward-behaviour screen (analogous to a forward genetic screen).

Enabling technology and accessibility
After the talks, one of the discussion points was about what technology is currently enabling tracking and analysis. The main ones were the availability of open source software for computer vision (and, increasingly, for behaviour analysis itself), the low cost of accurate sensors, and the possibility of rapidly prototyping hardware components using 3D printing to make an instrument that does just what you want. This is being strikingly illustrated to me today at a wonderful Champalimaud summer school where Isaac Bianco is currently getting the students to build fish tracking setups from scratch. They’ll be tracking centroid and orientation in real time by sundown!

I do still think it’s important to increase the accessibility of tracking technology though because many labs that would like to take advantage of these approaches aren’t always setup to implement them even if software and designs are open source. I think the way around this is a commercial tracker based on open source hardware and software, the idea being that it can be adapted to specific groups’ needs if they like, but it will work out of the box for groups that just want to get some tracking data. The reason I believe this must be commercially available is the much bemoaned state of academic technology more generally: the incentives are not right to make things useable or provide support, and it’s difficult to get funding for this unglamorous task. See, for example here.

Overall, it was an exciting workshop and I would like to thank the speakers again, as well as the audience for taking part and the GSA for organising TAGC. I thought it was great to have the different model organisms in the same place.

  1. ms access setup support number    246 days ago    #

    Keep sharing post like this and we all loved this.

  2. paper review service    238 days ago    #

    TAGC lunched their new tracking system recently that have much sensor to track any thing. I like to buy it and I am going for it soon. I hope this summery help you too to understand.

  3. ambitz    228 days ago    #

    Thank you for the posts. This article is very useful.
    Thank you very much.
    รองเท้ากีฬา น่ารู้

  4. sahmon    218 days ago    #

    Thank you for everything you have done and share with me.



  5. MS Office Customer Service @1-800-231-4685    205 days ago    #

    Our live MS office customer service number comes with a number of benefits to you as a user, including affordability, ease of employ and reduced turnaround time to fix the problem.

  6. Cisco Customer Support    192 days ago    #

    The Place Of info have the nice information thanks for sharing. If you need Asus router customer service Help, Use Our Service.

  7. Online Economics Assignment Help    190 days ago    #

    by visiting this site I found cool stuff here keep it up.

  8. Saket Call Girls    180 days ago    #

    It was a good quality post and I thoroughly enjoy the way you present this topic. We are hopefully waiting for this type of posts.

  9. Online Dissertation Help    175 days ago    #

    Hi Buddy, Your Blog’ S Design Is Simple And Clean And I Like It. Your Blog Posts About Online Writing Help Are Superb. Please Keep Them Coming. Greets!

  10. donald trump florida    169 days ago    #

    I know your aptitude on this. I should say we ought to have an online discourse on this. Composing just remarks will close the talk straight away! What’s more, will confine the advantages from this data.

  11. Database Assignment Help Assistance    163 days ago    #

    I personally like your post; you have shared good insights and experiences. Keep it up.

  12. Adjustable Dumbbells Comparison    163 days ago    #

    Hi buddy, your blog’ s design is simple and clean and i like it. Your blog posts about Online writing Help are superb. Please keep them coming. Greets!

  13. nunuy    156 days ago    #

    This information is very useful. thank you for sharing. and I will also share information about health through the website

    <a href=“”>Cara Menyembuhkan Sakit Maag</a>
    <a href=“”>Cara Menghilangkan Bruntusan</a>
    <a href=“”>Cara Mengatasi Asam Lambung</a>
    <a href=“”>Cara Mengobati Gusi Bengkak</a>
    <a href=“”>Cara Menyembuhkan Mata Minus</a>

  14. giant outdoor games    154 days ago    #

    Increasing the accessibility of tracking technology is very important, I share your thoughts on this. Workshops like these are very important.

  15. obat sariawan alami    133 days ago    #

    This information is very useful. thank you for sharing. and I will also share information about health through the website

    <a href=“”>Cara Menghilangkan Bopeng</a>
    <a href=“”>Obat Penghilang Nyeri Lutut</a>
    <a href=“”>Obat Penghilang Nyeri Pada Payudara</a>
    <a href=“”>Obat Sakit Mata Belekan Alami</a>
    <a href=“”>Cara Mengatasi Diare</a>
    <a href=“”>Obat Sakit Dada</a>

  16. seo service in delhi    80 days ago    #

    Thanks for share with me this information

  17. travel company in delhi    80 days ago    #

    Visit here

  18. DataBase Assignment Expert    65 days ago    #

    Pretty Helpful Material, Much Thanks For This Article.

  19. DataBase Assignment Expert    65 days ago    #

    Pretty Helpful Material, Much Thanks For This Article.

  20. DataBase Assignment Expert    65 days ago    #

    Pretty Helpful Material, Much Thanks For This Article.

  21. DataBase Assignment Expert    65 days ago    #

    Pretty Helpful Material, Much Thanks For This Article.

  22. SimBiology Homework Help Australia    64 days ago    #

    Amazing Article Thanks Or Sharing..

  23. Programming in Java Assignment Help    59 days ago    #

    They Are Not Able To Finish The Writing Assignments On Time. For Some Students, Writing Any Writing Assignments Is Able To Waste Their Time.

  24. Corporate Finance Project Help    58 days ago    #

    I Loved The Way You Discuss The Topic Great Work Thanks For The Share Your Informative Post.

  25. Case study solutions    53 days ago    #

    I genuinely appreciated understanding it. Sitting tight for some more incredible articles like this from you in the nearing days

  26. Computer Science Assignment Help    53 days ago    #

    I loved the way you discuss the topic great work thanks for the share.

  27. Programming Project Help    51 days ago    #

    I loved the way you discuss the topic great work thanks for the share Your informative post.

  28. Mechanical Engineering Homework Help    51 days ago    #

    Those who come to read your article will find lots of helpful and informative tips

  29. ppc service in delhi    49 days ago    #

    For more infomration share with me

  30. travel agents in delhi    49 days ago    #

    For more information share with me

  31. lyrics with music    49 days ago    #

    lyrics with music

  32. reasons why you will never be successful    46 days ago    #

    Lyric music is one of my favourite. Must be honest.. You are very confident and have the high qualification. Good for you.

  33. Sociology Dissertation Writing Service    43 days ago    #

    Really i appreciate the effort you made to share the knowledge. This is really a great stuff for sharing. Keep it up . Thanks for sharing.

  34. Delhi escort    30 days ago    #

    Hello, I am Nidhi singh I am 24 years old my eyes are dark brown and my hair could be dark brown I’m rather tall sexy sexy model I love to go out partying with new boys and have a good deal of pleasure and fun I love to give a whole lot of pleasure and provide supreme passion you will achieve new heights. And also have a great deal of crazy fun with me come to town of Delhi to meet me and have the best time you’ve ever had I’d be heading out together or staying with you at the best of hotels Contact me as Delhi Escort Service.

  35. Escort Service in Andheri    23 days ago    #

    Book Andheri Escorts Services at low rates call on RiyaBatta for awesome Female Escorts in Mumbai. You can have fun with hot Model Mumbai Escort Girls 24/7.

  36. Do My Stats Homework    21 days ago    #

    The leading assignment help UK firm offers state of the art services to its clients with a promise of delivering all the required work well within the deadline.

  37. Sociology Writing Help    21 days ago    #

    Thanks a lot for the post. It has helped me get some nice ideas. I hope I will see some really good result soon.

  38.    21 days ago    #

    John arnold is an academic writer of the Dissertation-Guidance. Who writes quality academic papers for students to help them in accomplishing their goals.

  39. Delhi escort service    8 days ago    #

    Hi i am Jiya singh, you know I am very much happy now and I dont know how to celebrate such a major event. Alright what we do, we come nearer to each other and celebrate it together as it is very much big news to me as you come to my site. I like to put in your arms and give you some of the best things and the benefits that you always need from every single girl but now you do not have to worry about anything as I am going to complete all that sort of needs only for you and this is why I am here and become an busty model escorts in Delhi.

  40. mindfulness meditation in india    8 days ago    #

    Very useful information. This is really helpful. Thank you for sharing.

  41. reiki treatment course in india    8 days ago    #

    This is very useful information, Thank you for sharing your experience.

  42. best fast food restaurant gurgaon    7 days ago    #

    Very nice post. very useful work for us. thank you for sharing.

  43. PPC Service in delhi    7 days ago    #

    Visit here for more information

  44. Bali honeymoon packages    7 days ago    #

    visit here

  45. lyrics with music    7 days ago    #

    read all sdong lyrics

  46. best cutlets in gurgaon    7 days ago    #

    Good article .thank you for sharing. very good information

  47. Best paneer pakora in Gurgaon    7 days ago    #

    Very nice post. very useful work for us. thank you for sharing.

  48. astrologer in Delhi    6 days ago    #

    This is very good article. Nice sharing this important blog. Thank you again for this useful sharing.

  49. peehubhalla    4 days ago    #

    awesome and helpful article. For more information you can visit my site. thank you for sharing this post.

  Textile help