What's in a Badge? A Computational Reproducibility Investigation of the Open Data Badge Policy in One Issue of Psychological Science.

In April 2019, Psychological Science published its first issue in which all Research Articles received the Open Data badge. We used that issue to investigate the effectiveness of this badge, focusing on the adherence to its aim at Psychological Science: sharing both data and code to ensure reproducibility of results. Twelve researchers of varying experience levels attempted to reproduce the results of the empirical articles in the target issue (at least three researchers per article). We found that all 14 articles provided at least some data and six provided analysis code, but only one article was rated to be exactly reproducible, and three were rated as essentially reproducible with minor deviations. We suggest that researchers should be encouraged to adhere to the higher standard in force at Psychological Science. Moreover, a check of reproducibility during peer review may be preferable to the disclosure method of awarding badges.

Improving the flexibility of genetically encoded voltage indicators via intermolecular FRET.

A new family of genetically encoded voltage indicators (GEVIs) has been developed based on intermolecular Förster resonance energy transfer (FRET). To test the hypothesis that the GEVI ArcLight functions via interactions between the fluorescent protein (FP) domains of neighboring probes, the FP of ArcLight was replaced with either a FRET donor or acceptor FP. We discovered relatively large FRET signals only when cells were cotransfected with both the FRET donor and acceptor GEVIs. Using a cyan fluorescent protein donor and an RFP acceptor, we were able to observe a voltage-dependent signal with an emission peak separated by over 200 nm from the excitation wavelength. The intermolecular FRET strategy also works for rhodopsin-based probes, potentially improving their flexibility as well. Separating the FRET pair into two distinct proteins has important advantages over intramolecular FRET constructs. The signals are larger because the voltage-induced conformational change moves two FPs independently. The expression of the FRET donor and acceptor can also be restricted independently, enabling greater cell type specificity as well as refined subcellular voltage reporting.

Mechanism of ArcLight derived GEVIs involves electrostatic interactions that can affect proton wires.

The genetically encoded voltage indicators ArcLight and its derivatives mediate voltage-dependent optical signals by intermolecular, electrostatic interactions between neighboring fluorescent proteins (FPs). A random mutagenesis event placed a negative charge on the exterior of the FP, resulting in a greater than 10-fold improvement of the voltage-dependent optical signal. Repositioning this negative charge on the exterior of the FP reversed the polarity of voltage-dependent optical signals, suggesting the presence of "hot spots" capable of interacting with the negative charge on a neighboring FP, thereby changing the fluorescent output. To explore the potential effect on the chromophore state, voltage-clamp fluorometry was performed with alternating excitation at 390 nm followed by excitation at 470 nm, resulting in several mutants exhibiting voltage-dependent, ratiometric optical signals of opposing polarities. However, the kinetics, voltage ranges, and optimal FP fusion sites were different depending on the wavelength of excitation. These results suggest that the FP has external, electrostatic pathways capable of quenching fluorescence that are wavelength specific. One mutation to the FP (E222H) showed a voltage-dependent increase in fluorescence when excited at 390 nm, indicating the ability to affect the proton wire from the protonated chromophore to the H222 position. ArcLight-derived sensors may therefore offer a novel way to map how conditions external to the ß-can structure can affect the fluorescence of the chromophore and transiently affect those pathways via conformational changes mediated by manipulating membrane potential.

GEVI cell-type specific labelling and a manifold learning approach provide evidence for lateral inhibition at the population level in the mouse hippocampal CA1 area.

The CA1 area in the mammalian hippocampus is essential for spatial learning. Pyramidal cells are the hippocampus output neurons and their activities are regulated by inhibition exerted by a diversified population of interneurons. Lateral inhibition has been suggested as the mechanism enabling the reconfiguration of pyramidal cell assembly activity observed during spatial learning tasks in rodents. However, lateral inhibition in the CA1 lacks the overwhelming evidence reported in other hippocampal areas such as the CA3 and the dentate gyrus. The use of genetically encoded voltage indicators and fast optical recordings permits the construction of cell-type specific response maps of neuronal activity. Here, we labelled mouse CA1 pyramidal neurons with the genetically encoded voltage indicator ArcLight and optically recorded their response to Schaffer Collaterals stimulation in vitro. By undertaking a manifold learning approach, we report a hyperpolarization-dominated area focused in the perisomatic region of pyramidal cells receiving late excitatory synaptic input. Functional network organization metrics revealed that information transfer was higher in this area. The localized hyperpolarization disappeared when GABAA receptors were pharmacologically blocked. This is the first report where the spatiotemporal pattern of lateral inhibition is visualized in the CA1 by expressing a genetically encoded voltage indicator selectively in principal neurons. Our analysis suggests a fundamental role of lateral inhibition in CA1 information processing.

Biophysical Parameters of GEVIs: Considerations for Imaging Voltage.

Genetically encoded voltage indicators (GEVIs) continue to evolve, resulting in many different probes with varying strengths and weaknesses. Developers of new GEVIs tend to highlight their positive features. A recent article from an independent laboratory has compared the signal/noise ratios of a number of GEVIs. Such a comparison can be helpful to investigators eager to try to image the voltage of excitable cells. In this perspective, we will present examples of how the biophysical features of GEVIs affect the imaging of excitable cells in an effort to assist researchers when considering probes for their specific needs.

Mapping of excitatory and inhibitory postsynaptic potentials of neuronal populations in hippocampal slices using the GEVI, ArcLight.

To understand the circuitry of the brain, it is essential to clarify the functional connectivity among distinct neuronal populations. For this purpose, neuronal activity imaging using genetically-encoded calcium sensors such as GCaMP has been a powerful approach due to its cell-type specificity. However, calcium (Ca2+) is an indirect measure of neuronal activity. A more direct approach would be to use genetically encoded voltage indicators (GEVIs) to observe subthreshold, synaptic activities. The GEVI, ArcLight, which exhibits large fluorescence transients in response to voltage, was expressed in excitatory neurons of the mouse CA1 hippocampus. Fluorescent signals in response to the electrical stimulation of the Schaffer collateral axons were observed in brain slice preparations. ArcLight was able to map both excitatory and inhibitory inputs projected to excitatory neurons. In contrast, the Ca2+ signal detected by GCaMP6f, was only associated with excitatory inputs. ArcLight and similar voltage sensing probes are also becoming powerful paradigms for functional connectivity mapping of brain circuitry.

Voltage and Calcium Imaging of Brain Activity.

Sensors for imaging brain activity have been under development for almost 50 years. The development of some of these tools is relatively mature, whereas qualitative improvements of others are needed and are actively pursued. In particular, genetically encoded voltage indicators are just now starting to be used to answer neurobiological questions and, at the same time, more than 10 laboratories are working to improve them. In this Biophysical Perspective, we attempt to discuss the present state of the art and indicate areas of active development.

Combinatorial mutagenesis of the voltage-sensing domain enables the optical resolution of action potentials firing at 60 Hz by a genetically encoded fluorescent sensor of membrane potential.

ArcLight is a genetically encoded fluorescent voltage sensor using the voltage-sensing domain of the voltage-sensing phosphatase from Ciona intestinalis that gives a large but slow-responding optical signal in response to changes in membrane potential (Jin et al., 2012). Fluorescent voltage sensors using the voltage-sensing domain from other species give faster yet weaker optical signals (Baker et al., 2012; Han et al., 2013). Sequence alignment of voltage-sensing phosphatases from different species revealed conserved polar and charged residues at 7 aa intervals in the S1-S3 transmembrane segments of the voltage-sensing domain, suggesting potential coil-coil interactions. The contribution of these residues to the voltage-induced optical signal was tested using a cassette mutagenesis screen by flanking each transmembrane segment with unique restriction sites to allow for the testing of individual mutations in each transmembrane segment, as well as combinations in all four transmembrane segments. Addition of a counter charge in S2 improved the kinetics of the optical response. A double mutation in the S4 domain dramatically reduced the slow component of the optical signal seen in ArcLight. Combining that double S4 mutant with the mutation in the S2 domain yielded a probe with kinetics <10 ms. Optimization of the linker sequence between S4 and the fluorescent protein resulted in a new ArcLight-derived probe, Bongwoori, capable of resolving action potentials in a hippocampal neuron firing at 60 Hz. Additional manipulation of the voltage-sensing domain could potentially lead to fluorescent sensors capable of optically resolving neuronal inhibition and subthreshold synaptic activity.

Imaging voltage in zebrafish as a route to characterizing a vertebrate functional connectome: promises and pitfalls of genetically encoded indicators.

Neural circuits are non-linear dynamical systems that transform information based on the pattern of input, current state and functional connectivity. To understand how a given stimulus is processed, one would ideally record neural activity across the entire brain of a behaving animal, at cellular or even subcellular resolution, in addition to characterizing anatomical connectivity. Given their transparency and relatively small size, larval zebrafish provide a powerful system for brain-wide monitoring of neural activity. Genetically encoded calcium indicators have been used for this purpose, but cannot directly report hyperpolarization or sub-threshold activity. Voltage indicators, in contrast, have this capability. Here, we test whether two different genetically encoded voltage reporters, ASAP1 and Bongwoori, can be expressed and report activity in the zebrafish brain, using widefield, two-photon and light sheet microscopy. We were unable to express ASAP1 in neurons. Bongwoori, in contrast expressed well, and because of its membrane localization, allowed visualization of axon trajectories in 3D. Bongwoori displayed stimulus-evoked changes in fluorescence, which could be detected in single trials. However, under high laser illumination, puncta on neural membranes underwent spontaneous fluctuations in intensity, suggesting that the probe is susceptible to blinking artefacts. These data indicate that larval zebrafish can be used to image electrical activity in the brain of an intact vertebrate at high resolution, although care is needed in imaging and analysis. Recording activity across the whole brain will benefit from further developments in imaging hardware and indicators.

Genetically Encoded Protein Sensors of Membrane Potential.

Organic voltage-sensitive dyes offer very high spatial and temporal resolution for imaging neuronal function. However these dyes suffer from the drawbacks of non-specificity of cell staining and low accessibility of the dye to some cell types. Further progress in imaging activity is expected from the development of genetically encoded fluorescent sensors of membrane potential. Cell type specificity of expression of these fluorescent protein (FP) voltage sensors can be obtained via several different mechanisms. One is cell type specificity of infection by individual virus subtypes. A second mechanism is specificity of promoter expression in individual cell types. A third, depends on the offspring of transgenic animals with cell type specific expression of cre recombinase mated with an animal that has the DNA for the FP voltage sensor in all of its cells but its expression is dependent on the recombinase activity. Challenges remain. First, the response time constants of many of the new FP voltage sensors are slower (2-10 ms) than those of organic dyes. This results in a relatively small fractional fluorescence change, ΔF/F, for action potentials. Second, the largest signal presently available is only ~40% for a 100 mV depolarization and many of the new probes have signals that are substantially smaller. Large signals are especially important when attempting to detect fast events because the shorter measurement interval results in a relatively small number of detected photons and therefore a relatively large shot noise (see Chap. 1). Another kind of challenge has occurred when attempts were made to transition from one species to another or from one cell type to another or from cell culture to in vivo measurements.Several laboratories have recently described a number of novel FP voltage sensors. Here we attempt to critically review the current status of these developments in terms of signal size, time course, and in vivo function.

S1 hydrophobic residues modulate voltage sensing phosphatase enzymatic function and voltage sensing.

The voltage sensing domain (VSD) is a four-helix modular protein domain that converts electrical signals into conformational changes, leading to open pores and active enzymes. In most voltage sensing proteins, the VSDs do not interact with one another and the S1-S3 helices are considered mainly as scaffolding. The two exceptions are the voltage sensing phosphatase (VSP) and the proton channel (Hv). VSP is a voltage-regulated enzyme and Hvs are channels that only have VSDs. To investigate the S1 contribution to VSP function, we individually mutated four hydrophobic amino acids in S1 to alanine (F127, I131, I134 and L137). We also combined these mutations to generate quadruple mutation designated S1-Q. Most of these mutations shifted the voltage dependence of activity to higher voltages though interestingly, not all substrate reactions were the same. The kinetics of enzymatic activity were also altered with some mutations significantly slowing down dephosphorylation. The voltage dependence of VSD motions were consistently shifted to lower voltages and indicated a second voltage dependent motion. Co-immunoprecipitation demonstrated that none of the mutations broke the VSP dimer indicating that the S1 impact could stem from intrasubunit and/or intersubunit interactions. Lastly, when the same alanine mutations were introduced into a genetically encoded voltage indicator, they dramatically altered the optical readings, making some of the kinetics faster and shifting the voltage dependence. These results indicate that the S1 helix in VSP plays a critical role in tuning the enzymes conformational response to membrane potential transients and influencing the function of the VSD.

Hydrophobic residues in S1 modulate enzymatic function and voltage sensing in voltage-sensing phosphatase.

The voltage-sensing domain (VSD) is a four-helix modular protein domain that converts electrical signals into conformational changes, leading to open pores and active enzymes. In most voltage-sensing proteins, the VSDs do not interact with one another, and the S1-S3 helices are considered mainly scaffolding, except in the voltage-sensing phosphatase (VSP) and the proton channel (Hv). To investigate its contribution to VSP function, we mutated four hydrophobic amino acids in S1 to alanine (F127, I131, I134, and L137), individually or in combination. Most of these mutations shifted the voltage dependence of activity to higher voltages; however, not all substrate reactions were the same. The kinetics of enzymatic activity were also altered, with some mutations significantly slowing down dephosphorylation. The voltage dependence of VSD motions was consistently shifted to lower voltages and indicated a second voltage-dependent motion. Additionally, none of the mutations broke the VSP dimer, indicating that the S1 impact could stem from intra- and/or intersubunit interactions. Lastly, when the same mutations were introduced into a genetically encoded voltage indicator, they dramatically altered the optical readings, making some of the kinetics faster and shifting the voltage dependence. These results indicate that the S1 helix in VSP plays a critical role in tuning the enzyme's conformational response to membrane potential transients and influencing the function of the VSD.

We don't know what you did last summer. On the importance of transparent reporting of reaction time data pre-processing.

In behavioral, cognitive, and social sciences, reaction time measures are an important source of information. However, analyses on reaction time data are affected by researchers' analytical choices and the order in which these choices are applied. The results of a systematic literature review, presented in this paper, revealed that the justification for and order in which analytical choices are conducted are rarely reported, leading to difficulty in reproducing results and interpreting mixed findings. To address this methodological shortcoming, we created a checklist on reporting reaction time pre-processing to make these decisions more explicit, improve transparency, and thus, promote best practices within the field. The importance of the pre-processing checklist was additionally supported by an expert consensus survey and a multiverse analysis. Consequently, we appeal for maximal transparency on all methods applied and offer a checklist to improve replicability and reproducibility of studies that use reaction time measures.

Teaching open and reproducible scholarship: a critical review of the evidence base for current pedagogical methods and their outcomes.

In recent years, the scientific community has called for improvements in the credibility, robustness and reproducibility of research, characterized by increased interest and promotion of open and transparent research practices. While progress has been positive, there is a lack of consideration about how this approach can be embedded into undergraduate and postgraduate research training. Specifically, a critical overview of the literature which investigates how integrating open and reproducible science may influence student outcomes is needed. In this paper, we provide the first critical review of literature surrounding the integration of open and reproducible scholarship into teaching and learning and its associated outcomes in students. Our review highlighted how embedding open and reproducible scholarship appears to be associated with (i) students' scientific literacies (i.e. students' understanding of open research, consumption of science and the development of transferable skills); (ii) student engagement (i.e. motivation and engagement with learning, collaboration and engagement in open research) and (iii) students' attitudes towards science (i.e. trust in science and confidence in research findings). However, our review also identified a need for more robust and rigorous methods within pedagogical research, including more interventional and experimental evaluations of teaching practice. We discuss implications for teaching and learning scholarship.

Conserved Amino Acids Residing Outside the Voltage Field Can Shift the Voltage Sensitivity and Increase the Signal Speed and Size of Ciona Based GEVIs.

To identify potential regions of the voltage-sensing domain that could shift the voltage sensitivity of Ciona intestinalis based Genetically Encoded Voltage Indicators (GEVIs), we aligned the amino acid sequences of voltage-gated sodium channels from different organisms. Conserved polar residues were identified at multiple transmembrane/loop junctions in the voltage sensing domain. Similar conservation of polar amino acids was found in the voltage-sensing domain of the voltage-sensing phosphatase gene family. These conserved residues were mutated to nonpolar or oppositely charged amino acids in a GEVI that utilizes the voltage sensing domain of the voltage sensing phosphatase from Ciona fused to the fluorescent protein, super ecliptic pHluorin (A227D). Different mutations shifted the voltage sensitivity to more positive or more negative membrane potentials. Double mutants were then created by selecting constructs that shifted the optical signal to a more physiologically relevant voltage range. Introduction of these mutations into previously developed GEVIs resulted in Plos6-v2 which improved the dynamic range to 40% ΔF/F/100 mV, a 25% increase over the parent, ArcLight. The onset time constant of Plos6-v2 is also 50% faster than ArcLight. Thus, Plos6-v2 appears to be the GEVI of choice.

A trafficking motif alters GEVI activity implicating persistent protein interactions at the membrane.

Efficient plasma-membrane expression is critical for genetically encoded voltage indicators (GEVIs). To improve the plasma-membrane expression, we introduced multiple combinations of plasma-membrane trafficking motifs at different positions to members of the Bongwoori family of GEVIs. An improvement from 20% to 27% in the ΔF/F/100 mV depolarization of the plasma membrane was observed when a Golgi transport motif was inserted near the N-terminus in conjunction with an endoplasmic reticulum release motif near the C-terminus of the protein. Unfortunately, this variant was also slower. The weighted tau on of the variant (25 ms) was more than double the original construct (11 ms). The weighted tau off was >20 ms compared with 10 ms for the original GEVI. The voltage range of the GEVI was also shifted to more negative potentials. Insertion of spacer amino acids between the fluorescent-protein domain and the endoplasmic reticulum release motif at the C-terminus rescued the speed of both the tau on and tau off while restoring the voltage range and maintaining the improved voltage-dependent optical signal. These results suggest that while trafficking motifs do improve plasma-membrane expression, they may also mediate persistent associations that affect the functioning of the protein.

A Multimodal Multi-Shank Fluorescence Neural Probe for Cell-Type-Specific Electrophysiology in Multiple Regions across a Neural Circuit.

Cell-type-specific, activity-dependent electrophysiology can allow in-depth analysis of functional connectivity inside complex neural circuits composed of various cell types. To date, optics-based fluorescence recording devices enable monitoring cell-type-specific activities. However, the monitoring is typically limited to a single brain region, and the temporal resolution is significantly low. Herein, a multimodal multi-shank fluorescence neural probe that allows cell-type-specific electrophysiology from multiple deep-brain regions at a high spatiotemporal resolution is presented. A photodiode and an electrode-array pair are monolithically integrated on each tip of a minimal-form-factor silicon device. Both fluorescence and electrical signals are successfully measured simultaneously in GCaMP6f expressing mice, and the cell type from sorted neural spikes is identified. The probe's capability of combined electro-optical recordings for cell-type-specific electrophysiology at multiple brain regions within a neural circuit is demonstrated. The new experimental paradigm to enable the precise investigation of functional connectivity inside and across complex neural circuits composed of various cell types is expected.

Visualizing Oscillations in Brain Slices With Genetically Encoded Voltage Indicators.

Genetically encoded voltage indicators (GEVIs) expressed pan-neuronally were able to optically resolve bicuculline induced spontaneous oscillations in brain slices of the mouse motor cortex. Three GEVIs were used that differ in their timing of response to voltage transients as well as in their voltage ranges. The duration, number of cycles, and frequency of the recorded oscillations reflected the characteristics of each GEVI used. Multiple oscillations imaged in the same slice never originated at the same location, indicating the lack of a "hot spot" for induction of the voltage changes. Comparison of pan-neuronal, Ca2+/calmodulin-dependent protein kinase II α restricted, and parvalbumin restricted GEVI expression revealed distinct profiles for the excitatory and inhibitory cells in the spontaneous oscillations of the motor cortex. Resolving voltage fluctuations across space, time, and cell types with GEVIs represent a powerful approach to dissecting neuronal circuit activity.

Wide-field and two-photon imaging of brain activity with voltage- and calcium-sensitive dyes.

This chapter presents three examples of imaging brain activity with voltage- or calcium-sensitive dyes. Because experimental measurements are limited by low sensitivity, the chapter then discusses the methodological aspects that are critical for optimal signal-to-noise ratio. Two of the examples use wide-field (1-photon) imaging and the third uses two-photon scanning microscopy. These methods have relatively high temporal resolution ranging from 10 to 10,000 Hz. The three examples are the following: (1) Internally injected voltage-sensitive dye can be used to monitor membrane potential in the dendrites of invertebrate and vertebrate neurons in in vitro preparations. These experiments are directed at understanding how individual neurons convert the complex input synaptic activity into the output spike train. (2) Recently developed methods for staining many individual cells in the mammalian brain with calcium-sensitive dyes together with two-photon microscopy made it possible to follow the spike activity of many neurons simultaneously while in vivo preparations are responding to stimulation. (3) Calcium-sensitive dyes that are internalized into olfactory receptor neurons in the nose will, after several days, be transported to the nerve terminals of these cells in the olfactory bulb glomeruli. There, the population signals can be used as a measure of the input from the nose to the bulb. Three kinds of noise in measuring light intensity are discussed: (1) Shot noise from the random emission of photons from the preparation. (2) Extraneous (technical) noise from external sources. (3) Noise that occurs in the absence of light, the dark noise. In addition, we briefly discuss the light sources, the optics, and the detectors and cameras. The commonly used organic voltage and ion sensitive dyes stain all of the cell types in the preparation indiscriminately. A major effort is underway to find methods for staining individual cell types in the brain selectively. Most of these efforts center around fluorescent protein activity sensors because transgenic methods can be used to express them in individual cell types.

Engineering Photoactivatability in Genetically Encoded Voltage and pH Indicators.

Genetically-encoded indicators of neuronal activity enable the labeling of a genetically defined population of neurons to optically monitor their activities. However, researchers often find difficulties in identifying relevant signals from excessive background fluorescence. A photoactivatable version of a genetically encoded calcium indicator, sPA-GCaMP6f is a good example of circumventing such an obstacle by limiting the fluorescence to a region of interest defined by the user. Here, we apply this strategy to genetically encoded voltage (GEVI) and pH (GEPI) indicators. Three photoactivatable GEVI candidates were considered. The first one used a circularly-permuted fluorescent protein, the second design involved a Förster resonance energy transfer (FRET) pair, and the third approach employed a pH-sensitive variant of GFP, ecliptic pHluorin. The candidate with a variant of ecliptic pHluorin exhibited photoactivation and a voltage-dependent fluorescence change. This effort also yielded a pH-sensitive photoactivatable GFP that varies its brightness in response to intracellular pH changes.