Our psychophysical evaluation of our CNN-based texture model is now available on bioRxiv. In the study led by Tom Wallis, we compared our recent parameteric model of texture appearance (CNN model) that uses the features encoded by a deep convolutional neural network (VGG-19) with two other models: the venerable Portilla and Simoncelli model (PS) and an extension of the CNN model in which the power spectrum is additionally matched.
We just put a preprint on arXiv describing a number of improvements to the style transfer algorithm we developed a while ago. These new features include spatial control, color control and scale control.
Spatial control: applying different styles to different parts of the image (panel b).
Color control: transferring only the style of a painting, but keeping the colors of the original photograph (panel c). You can find additional examples in our blog post on blog.deepart.io.
Scale control: combine small-scale features of one style with large-scale features of another.
In a new paper that just came out in the Journal of Neuroscience we investigate how unobserved fluctuations in attentional state can induce correlated variability among neuronal populations. Interestingly, we found that an extremely simple model that treats attentional state as a shared gain can explain a wide variety of experimental findings on correlated variability.
Our paper A neural algorithm of artistic style (posted on arXiv on Aug 26) is ranked #9 among the most widely discussed and shared academic papers in 2015. See here for the top 100 list and the Altmetric report for our paper. Remarkably, in the all-time stats it ranks #102 out of more than 4.6 million articles.
Philipp Berens and I received a teaching award from the senior students of the Master’s program in Neural Information Processing for our course Neural Data Analysis in the summer term 2015.
We have a new paper published today in Science. Xiaolong Jiang in Andreas Tolias’ lab at Baylor College of Medicine recorded, labeled, and classified over 1600 neurons in mouse visual cortex and characterized their connectivity. Based on his remarkable work we discovered three simple connectivity rules that capture most of the structure of the connectivity matrix:
- There are two master regulators with distinct input profiles.
- Interneuron-selective interneurons are neither self-inhibitory nor locally recruited.
- Pyramidal-neuron-targeting interneurons are self-inhibitory and locally recruited.
The paper has already attracted some media attention on Popular Mechanics, The Scientist and some German news outlets.
We recently founded Pro-Test Germany, a non-profit organization by young scientists with the goal of communicating and educating about the need of using animals in research.
Whether or not we should use animals in research is a controversial question. While it is clear to a neuroscientist like myself that we need animal research to make progress in basic research and medicine, it may not be as obvious to someone who has never done science or even met a scientist.
Unfortunately, in Germany the public dispute on this topic has been dominated by animal rights activists with extreme views. Scientists, on the other hand, have mostly preferred to do their work instead of engaging with the public. After the recent events in Tübingen that forced Max Planck director Nikos Logothetis to give up his work with macaque monkeys, it has become clear to many of us that this needs to change. Scientists have to speak up, get out there, and talk about their work: What do we do? Why do we do it? Why is it necessary? How does it help society? To help answering these questions for everybody, we started Pro-Test Germany. We will have a website, be active on social media and have public actions in Tübingen. Visit our website or Facebook page and stay tuned!
My grant proposal “Probabilistic inference in primary visual cortex” has been funded by the DFG. It’s a joint project with Matthias Bethge, Andreas Tolias and Ralf Häfner. I’m excited to get started!
I am a scientist based in Tübingen, Germany. Working at the intersection of computational neuroscience, machine learning and computer vision, I would like to understand how neural systems – both biological and artificial – perform visual perception.
Learn more about my research and my publications.
Our paper describing how population activity in primate V1 depends on brain state has been published today in Neuron.
We used multi-tetrode recording arrays to record from up to 64 neurons simultaneously in both awake and anesthetized monkeys. Remarkably, in anesthetized animals there was a strong common fluctuation of firing rates on a timescale of 200–500 ms, which was absent during the awake state. To model these fluctuations we used a latent variable model called Gaussian Process Factor Analysis (Yu et al. 2009). After accounting for a single common modulator, the correlation structure in the anesthetized state matched that during wakefulness almost perfectly.
As usual, code and data are publicly available on our website.