Home

Welcome to the Castellucci Lab at URochester

We study how human and animal brains coordinate vocalization, gesture, and other nonvocal movements into fluent multi-effector behaviors.

Collage of statues around the University of Rochester campus, showing gesture and body language
gesture and body language around campus

Research

How does the brain generate flexible combinations of vocalization and gesture?

Speech is almost always accompanied by gestures of the hands, face, head, torso, etc. These co-speech gestures aren’t just “fidgets” or probabilistic “add-ons” to spoken language – instead, they are semantically linked with what’s being said and coupled at a kinematic level with speech articulation itself. We also gesture when our conversational partners can’t see us, and people born blind gesture when they’re speaking. This all points to gesture being fundamentally entangled with the cognitive and motor pathways that govern language…but how does that actually work in the human mind and brain?

Research in the lab tackles this question in an integrative fashion, and we use neural and behavioral approaches to investigate the biological basis of multimodal communication (i.e., simultaneous speech/vocalization and gesture). Our research is primarily focused on production, and our experiments seek to understand how humans go about planning speech and gesture at the same time and how our motor systems coordinate the multiple effectors (i.e., body parts) that constitute these behaviors – and what happens when these processes are disrupted.

While multimodal signalling is a key feature of human communication, it is not unique to us; instead, multi-effector displays consisting of vocalization and ‘gestural’ actions have independently evolved in many species. By examining these nonhuman behaviors, our lab seeks to gain a holistic view of human communication – what features set it apart from other species, what evolutionary pressures shaped our social systems, and what generalizable neural and behavioral algorithms exist for coordinating vocalization and nonvocal movements into coherent communicative acts.

Us!

Speech and gesture in the human brain

The lab’s first line of research aims to understand how the human brain produces speech and gesture – often simultaneously – and we investigate this topic using a combination of intracranial recordings and perturbations (e.g., electrocorticography, direct electrical stimulation), targeted psycholinguistic experiments, and high-precision motion tracking. With the detailed neural and behavioral data resulting from this multi-scale approach, we are currently pursuing a number of foundational questions, such as: What are the brain areas underlying gesture and nonverbal communication? How do these areas interact with the language system during speech production? What’s ‘special’ about speech and gesture versus other multi-effector actions?

Two people conversing, using speech and co-speech gesture, with arrows indicating body and hand movement
humans use their entire bodies for communicative signalling
Blackbirds producing coordinated vocal and postural courtship displays, with arrows indicating body movement
icterid songbirds communicate with vocal, nonvocal, and multimodal behaviors

Other species

Comparative study of multimodal communication

Our second line of research aims to understand how the brains of other species have evolved to support multimodal communication. This work centers on New World blackbirds (‘icterids’, including cowbirds and grackles) – a family of songbirds that possess an extensive repertoire of vocalizations, nonvocal signals, and multimodal displays – and we collaborate with other labs to assess the communication systems of other avian and mammalian species. Our current studies focus on the behavioral and kinematic principles of various multimodal displays, with the goal of characterizing the different motor strategies that organisms (including humans) use to coordinate vocal and ‘gestural’ actions. These investigations also make predictions about the neural pathways underlying multi-effector displays, which we can directly test with electrophysiological recordings and perturbation experiments.

People

Our group

We are an interdisciplinary team of researchers using insights and approaches from linguistics, neuroscience, and ethology to investigate the biological basis of multimodal communication.

Our lab is affiliated with the Department of Brain and Cognitive Sciences, the Del Monte Institute for Neuroscience, and the Center for Language Sciences at the University of Rochester.

Gregg A. Castellucci

Gregg A. Castellucci, PhD

Principal Investigator · Assistant Professor, Brain & Cognitive Sciences

Postdoc, NYU
PhD, Yale University (Linguistics & Neuroscience)
BS, University at Albany, State University of New York

Photo — Baishen Liang

Baishen Liang

Postdoctoral Fellow

PhD, University of the Chinese Academy of Sciences (Cognitive Neuroscience)

What is the neural basis of coordinated speech and gesture production?

Placeholder photo (grackle) — Walter Dych

Walter Dych

Research Technician

BA, University of Delaware (Linguistics)

How do humans plan speech and gesture at the same time?

Placeholder photo (grackle) — Ava Lindon

Ava Lindon

Graduate Student · Incoming Jan 2027

BA, University of Oregon (Linguistics)

How does co-speech gesture relate to other multi-effector behaviors?

Photo — D'Juan Moreland

D'Juan Moreland

Graduate Student · University of Pennsylvania

BS, UMBC (Biological Sciences)

What is the neural basis of multimodal displays in the brown-headed cowbird?

Co-mentored with Marc Schmidt.

Photo — George Tsimis

George Tsimis

Graduate Student

BS, Cornell University (Neurobiology and Behavior)

What strategies are used by different species to coordinate vocal and gesture movements?

Placeholder photo (grackle) — Ziyang (Isabella) Wang

Ziyang (Isabella) Wang

Undergraduate Researcher

What evolutionary pressures lead to multimodal signalling in New World blackbirds?

Collaborators

  • Arkarup BanerjeeCold Spring Harbor Laboratory
  • Daril BrownPostdoc at UC Irvine · co-mentored with Fernanda Ferreira
  • Jeremy GreenleeUniversity of Iowa, Department of Neurosurgery
  • Jelena KrivokapićUniversity of Michigan, Department of Linguistics
  • Mac MacKayPostbacc at the University of Iowa · co-mentored with Jeremy Greenlee
  • Marc SchmidtUniversity of Pennsylvania, Department of Biology
  • Farhad TabasiPostdoc at the University of Iowa, Department of Neurosurgery

Alumni

Publications

Papers and preprints

See the full list on Google Scholar →

News

Talks, publications, noteworthy events, and more

August 3, 2026

D'Juan gives a talk at the UPenn Small Circuits & Behavior meeting

D.A. Moreland. "Coordination of Song and Dance in a Songbird."

June 5, 2026

D'Juan and Mac present their posters at the Neural Mechanisms of Acoustic Communication GRC!

M. MacKay, F. Tabasi, J.D.W. Greenlee, G.A. Castellucci. "Neural representation of coordinated speech and gesture."

D.A. Moreland, C.I. Bardjis, M.F. Schmidt, G.A. Castellucci. "Quantifying vocal-postural coupling during display in the cowbird."

April 22, 2026

Gregg gives a talk at the Society for the Neural Control of Movement annual meeting

G.A. Castellucci. "What can multimodal communication tell us about motor coordination?"