A NWB-based dataset and processing pipeline of human single-neuron activity during a declarative memory task.

A challenge for data sharing in systems neuroscience is the multitude of different data formats used. Neurodata Without Borders: Neurophysiology 2.0 (NWB:N) has emerged as a standardized data format for the storage of cellular-level data together with meta-data, stimulus information, and behavior. A key next step to facilitate NWB:N adoption is to provide easy to use processing pipelines to import/export data from/to NWB:N. Here, we present a NWB-formatted dataset of 1863 single neurons recorded from the medial temporal lobes of 59 human subjects undergoing intracranial monitoring while they performed a recognition memory task. We provide code to analyze and export/import stimuli, behavior, and electrophysiological recordings to/from NWB in both MATLAB and Python. The data files are NWB:N compliant, which affords interoperability between programming languages and operating systems. This combined data and code release is a case study for how to utilize NWB:N for human single-neuron recordings and enables easy re-use of this hard-to-obtain data for both teaching and research on the mechanisms of human memory.

Neuronal spiking in the pedunculopontine nucleus in progressive supranuclear palsy and in idiopathic Parkinson's disease.

The pedunculopontine nucleus (PPN) is engaged in posture and gait control, and neuronal degeneration in the PPN has been associated with Parkinsonian disorders. Clinical outcomes of deep brain stimulation of the PPN in idiopathic Parkinson's disease (IPD) and progressive supranuclear palsy (PSP) differ, and we investigated whether the PPN is differentially affected in these conditions. We had the rare opportunity to record continuous electrophysiological data intraoperatively in 30 s blocks from single microelectrode contacts implanted in the PPN in six PSP patients and three IPD patients during rest, passive movement, and active movement. Neuronal spikes were sorted according to shape using a wavelet-based clustering approach to enable comparisons between individual neuronal firing rates in the two disease states. The action potential widths showed a bimodal distribution consistent with previous findings, suggesting spikes from noncholinergic (likely glutamatergic) and cholinergic neurons. A higher PPN spiking rate of narrow action potentials was observed in the PSP than in the IPD patients when pooled across all three conditions (Wilcoxon rank sum test: p = 0.0141). No correlation was found between firing rate and disease severity or duration. The firing rates were higher during passive movement than rest and active movement in both groups, but the differences between conditions were not significant. PSP and IPD are believed to represent distinct disease processes, and our findings that the neuronal firing rates differ according to disease state support the proposal that pathological processes directly involving the PPN may be more pronounced in PSP than IPD.

A novel approach to the detection of synchronisation in EEG based on empirical mode decomposition.

Transient neural assemblies mediated by synchrony in particular frequency ranges are thought to underlie cognition. We propose a new approach to their detection, using empirical mode decomposition (EMD), a data-driven approach removing the need for arbitrary bandpass filter cut-offs. Phase locking is sought between modes. We explore the features of EMD, including making a quantitative assessment of its ability to preserve phase content of signals, and proceed to develop a statistical framework with which to assess synchrony episodes. Furthermore, we propose a new approach to ensure signal decomposition using EMD. We adapt the Hilbert spectrum to a time-frequency representation of phase locking and are able to locate synchrony successfully in time and frequency between synthetic signals reminiscent of EEG. We compare our approach, which we call EMD phase locking analysis (EMDPL) with existing methods and show it to offer improved time-frequency localisation of synchrony.

A single-band envelope cue as a supplement to speechreading of segmentals: a comparison of auditory versus tactual presentation.

OBJECTIVE: The objective of this study was to compare the effects of a single-band envelope cue as a supplement to speechreading of segmentals and sentences when presented through either the auditory or tactual modality. DESIGN: The supplementary signal, which consisted of a 200-Hz carrier amplitude-modulated by the envelope of an octave band of speech centered at 500 Hz, was presented through a high-performance single-channel vibrator for tactual stimulation or through headphones for auditory stimulation. Normal-hearing subjects were trained and tested on the identification of a set of 16 medial vowels in /b/-V-/d/ context and a set of 24 initial consonants in C-/a/-C context under five conditions: speechreading alone (S), auditory supplement alone (A), tactual supplement alone (T), speechreading combined with the auditory supplement (S+A), and speechreading combined with the tactual supplement (S+T). Performance on various speech features was examined to determine the contribution of different features toward improvements under the aided conditions for each modality. Performance on the combined conditions (S+A and S+T) was compared with predictions generated from a quantitative model of multi-modal performance. To explore the relationship between benefits for segmentals and for connected speech within the same subjects, sentence reception was also examined for the three conditions of S, S+A, and S+T. RESULTS: For segmentals, performance generally followed the pattern of T < A < S < S+T < S+A. Significant improvements to speechreading were observed with both the tactual and auditory supplements for consonants (10 and 23 percentage-point improvements, respectively), but only with the auditory supplement for vowels (a 10 percentage-point improvement). The results of the feature analyses indicated that improvements to speechreading arose primarily from improved performance on the features low and tense for vowels and on the features voicing, nasality, and plosion for consonants. These improvements were greater for auditory relative to tactual presentation. When predicted percent-correct scores for the multi-modal conditions were compared with observed scores, the predicted values always exceeded observed values and the predictions were somewhat more accurate for the S+A than for the S+T conditions. For sentences, significant improvements to speechreading were observed with both the auditory and tactual supplements for high-context materials but again only with the auditory supplement for low-context materials. The tactual supplement provided a relative gain to speechreading of roughly 25% for all materials except low-context sentences (where gain was only 10%), whereas the auditory supplement provided relative gains of roughly 50% (for vowels, consonants, and low-context sentences) to 75% (for high-context sentences). CONCLUSIONS: The envelope cue provides a significant benefit to the speechreading of consonant segments when presented through either the auditory or tactual modality and of vowel segments through audition only. These benefits were found to be related to the reception of the same types of features under both modalities (voicing, manner, and plosion for consonants and low and tense for vowels); however, benefits were larger for auditory compared with tactual presentation. The benefits observed for segmentals appear to carry over into benefits for sentence reception under both modalities.

Information transmission with a multifinger tactual display.

In this work, the tactual information transmission capabilities of a tactual display designed to provide stimulation along a continuum from kinesthetic movements to cutaneous vibrations are assessed. The display is capable of delivering arbitrary waveforms to three digits (thumb, index, and middle finger) within an amplitude range from absolute detection threshold to about 50 dB sensation level and a frequency range from dc to above 300 Hz. Stimulus sets were designed at each of three signal durations (125, 250, and 500 msec) by combining salient attributes, such as frequency (further divided into low, middle, and high regions), amplitude, direction of motion, and finger location. Estimated static information transfer (IT) was 6.5 bits at 500 msec, 6.4 bits at 250 msec, and 5.6 bits at 125 msec. Estimates of IT rate were derived from identification experiments in which the subject's task was to identify the middle stimulus in a sequence of three stimuli randomly selected from a given stimulus set. On the basis of the extrapolations from these IT measurements to continuous streams, the IT rate was estimated to be about 12 bits/sec, which is roughly the same as that achieved by Tadoma users in tactual speech communication.

Effects of rate of presentation on the reception of American Sign Language.

Previous research on the visual reception of fingerspelled English suggests that communication rates are limited primarily by constraints on production. Studies of artificially accelerated fingerspelling indicate that reception of fingerspelled sentences is highly accurate for rates up to 2 to 3 times those that can be produced naturally. The current paper reports on the results of a comparable study of the reception of American Sign Language (ASL). Fourteen native deaf ASL signers participated in an experiment in which videotaped productions of isolated ASL signs or ASL sentences were presented at normal playback speed and at speeds of 2, 3, 4, and 6 times normal speed. For isolated signs, identification scores decreased from 95% correct to 46% correct across the range of rates that were tested; for sentences, the ability to identify key signs decreased from 88% to 19% over the range of rates tested. The results indicate a breakdown in processing at around 2.5-3 times the normal rate as evidenced both by a substantial drop in intelligibility in this region and by a shift in error patterns away from semantic and toward formational. These results parallel those obtained in previous studies of the intelligibility of the auditory reception of time-compressed speech and the visual reception of accelerated fingerspelling. Taken together, these results suggest a modality-independent upper limit to language processing.

Controlling conditioning-related emesis in children undergoing bone marrow transplantation.

PURPOSE/OBJECTIVES: To compare the efficacy of two antiemetic regimens, ondansetron alone versus perphenazine with diphenhydramine, on emesis control in children undergoing conditioning therapy for bone marrow transplantation (BMT). DESIGN: Single-center, prospective, open, randomized, crossover study. SETTING: Pediatric BMT unit in an urban area in the northeastern United States. SAMPLE: 28 children, ages 4-17, undergoing BMT for a variety of underlying diseases. METHODS: After randomization to one of the two antiemetic regimens, emesis control was evaluated during conditioning therapy. If a participant experienced more than five episodes of emesis during any 12-hour period, he or she was crossed over to the other antiemetic regimen. If emesis control still was not achieved, the participant was removed from the study and other medications were administered to control vomiting. MAIN RESEARCH VARIABLES: Number of emetic episodes and incidence of side effects. FINDINGS: 10 of 15 patients (67%) who received ondansetron experienced major emesis control (no more than two episodes) compared with 0 of 13 patients (0%) who received perphenazine with diphenhydramine (p = 0.044, Fisher exact test). Of those who crossed over to ondansetron after failure with perphenazine and diphenhydramine, 38% were able to achieve major emesis control. CONCLUSIONS: Ondansetron offers superior antiemetic control over the combination of perphenazine and diphenhydramine for children undergoing high-dose chemotherapy with or without total body irradiation for BMT. IMPLICATIONS FOR NURSING PRACTICE: Oncology nurses must develop an understanding of the etiology of therapy-induced emesis and the mechanisms of action of the various classes of antiemetic agents designed to control it. Implementing documentation to describe events of emesis will help to tailor antiemetic therapy to a patient's specific situation. Further research is necessary to determine alternate strategies, including different combinations or sequences of antiemetics to provide optimum emetic control during acute and delayed phases of emesis. The higher cost of ondansetron therapy must be considered within the context of superior efficacy.

Reception of Morse code through motional, vibrotactile, and auditory stimulation.

The potential for communication through the kinesthetic aspect of the tactual sense was examined in a series of experiments employing Morse code signals. Experienced and inexperienced Morse code operators were trained to identify Morse code signals that were delivered as sequences of motional stimulation through up-down displacements (roughly 10 mm) of the fingertip. Performance on this task was compared with that obtained for both vibrotactile and acoustic presentation of Morse code using a 200-Hz tone delivered either to the fingertip through a minishaker or diotically to the two ears under headphones. For all three modalities, the ability to receive Morse code was examined as a function of presentation rate for tasks including identification of single letters, random three-letter sequences, common words, and sentences. Equivalent word-rate measures (i.e., product of percent correct scores and stimulus presentation rate) were nearly twice as high for auditory presentation as for vibrotactile stimulation, which in turn was about 1.3 times that for motional stimulation. The experienced subjects outperformed the inexperienced subjects by amounts that increased with task complexity. For example, the former were able to receive sentences at 18 words/min with motional stimulation, whereas the latter, following 75 h of training, were unable to perform this task. The present results and those of other research with tactual communication systems are compared, particularly regarding estimates of information-transfer rates.

Information transmission with a multi-finger tactual display.

Motivated by the highly successful Tadoma method of speech communication, a multi-finger positional display (the TACTUATOR) was developed to study perception via the kinesthetic and vibrotactile aspects of the tactual sensory system of the hand. The information transmission capabilities with the TACTUATOR were assessed through a series of absolute identification experiments. An information transfer (IT) of 5.6 to 6.5 bits for stimulus durations of 125 to 500 msec was obtained in absolute-identification experiments with sets of signals derived by varying frequency, amplitude, and site of stimulation of multicomponent waveforms. An estimated IT rate of 12 bits/sec was obtained by sequencing three random stimuli and (a) having the subject identify only the middle stimulus and (b) extrapolating this IT to that for continuous streams. This IT rate is roughly the same as that achieved by Tadoma users in tactual speech communication.

Speaking clearly for the hard of hearing IV: Further studies of the role of speaking rate.

The contribution of reduced speaking rate to the intelligibility of "clear" speech (Picheny, Durlach, & Braida, 1985) was evaluated by adjusting the durations of speech segments (a) via nonuniform signal time-scaling, (b) by deleting and inserting pauses, and (c) by eliciting materials from a professional speaker at a wide range of speaking rates. Key words in clearly spoken nonsense sentences were substantially more intelligible than those spoken conversationally (15 points) when presented in quiet for listeners with sensorineural impairments and when presented in a noise background to listeners with normal hearing. Repeated presentation of conversational materials also improved scores (6 points). However, degradations introduced by segment-by-segment time-scaling rendered this time-scaling technique problematic as a means of converting speaking styles. Scores for key words excised from these materials and presented in isolation generally exhibited the same trends as in sentence contexts. Manipulation of pause structure reduced scores both when additional pauses were introduced into conversational sentences and when pauses were deleted from clear sentences. Key-word scores for materials produced by a professional talker were inversely correlated with speaking rate, but conversational rate scores did not approach those of clear speech for other talkers. In all experiments, listeners with normal hearing exposed to flat-spectrum background noise performed similarly to listeners with hearing loss.

Dye coupling in the muscles controlling squid chromatophore expansion.

Dye coupling between the cone-shaped radial muscle fibres, which control the expansion and closing of a squid chromatophore organ, was investigated in the squid Loligo vulgaris. Particular attention was paid to the role of the myomuscular junctions located between the muscle fibres. Lucifer Yellow was injected ionophoretically into single muscle fibres under normal artificial sea water (ASW) and under various concentrations of calcium in ASW. Under ASW, 44% of muscle fibres examined were dye-coupled, 82% were coupled under calcium-free sea water and 67% were coupled under sea water containing high concentrations of calcium. Dye transfer was blocked by octanol. Muscle fibres were never seen to link adjacent chromatophore organs. Results are discussed in terms of the role of the myomuscular junctions in the regulation of chromatophore expansion in the living animal.

The ultrastructure and innervation of muscles controlling chromatophore expansion in the squid, Loligo vulgaris.

Squid chromatophores are organs of colour change, consisting of a pigment sac opened by contraction of 10-24 radial muscle fibres. The ultrastructure and innervation of these muscle fibres were examined by electron microscopy and diagramatic reconstructions made on the basis of serial ultra-thin sections. At the proximal end of the fibre, nearest the pigment sac a cortical myofilament zone surrounds 2 cores containing mitochrondria; further along the fibre these merge to form one central core. The myofilament zone forms a groove containing a nerve bundle consisting of 2 to 4 axons per muscle fibre. The axons are surrounded by glial cell processes, and either originate from a neighbouring fibre, or join the fibre at some point along its length. Axons twist around each other, forming a series of synapses with the muscle fibre. As many as 6-37 synapses exist along the length of each muscle fibre; the mean synapse interval is 9.05 microm, but the largest may be 123 microm. At the distal end of the muscles, the nerve is located towards the middle of the fibre, which it penetrates as the muscle splits up. Electron-lucent vesicles are present in all synaptic regions, but electron-dense vesicles are only found towards the distal end of the fibre. There is thus a possibility that more than one neurotransmitter is present in the nerves innervating chromatophores. Electron-lucent and dense-cored vesicles are not colocalised.

A study of the tactual reception of sign language.

One of the natural methods of tactual communication in common use among individuals who are both deaf and blind is the tactual reception of sign language. In this method, the receiver (who is deaf-blind) places a hand (or hands) on the dominant (or both) hand(s) of the signer in order to receive, through the tactual sense, the various formational properties associated with signs. In the study reported here, 10 experienced deaf-blind users of either American Sign Language (ASL) or Pidgin Sign English (PSE) participated in experiments to determine their ability to receive signed materials including isolated signs and sentences. A set of 122 isolated signs was received with an average accuracy of 87% correct. The most frequent type of error made in identifying isolated signs was related to misperception of individual phonological components of signs. For presentation of signed sentences (translations of the English CID sentences into ASL or PSE), the performance of individual subjects ranged from 60-85% correct reception of key signs. Performance on sentences was relatively independent of rate of presentation in signs/sec, which covered a range of roughly 1 to 3 signs/sec. Sentence errors were accounted for primarily by deletions and phonological and semantic/syntactic substitutions. Experimental results are discussed in terms of differences in performance for isolated signs and sentences, differences in error patterns for the ASL and PSE groups, and communication rates relative to visual reception of sign language and other natural methods of tactual communication.

Automatic speech recognition to aid the hearing impaired: prospects for the automatic generation of cued speech.

Although great strides have been made in the development of automatic speech recognition (ASR) systems, the communication performance achievable with the output of current real-time speech recognition systems would be extremely poor relative to normal speech reception. An alternate application of ASR technology to aid the hearing impaired would derive cues from the acoustical speech signal that could be used to supplement speechreading. We report a study of highly trained receivers of Manual Cued Speech that indicates that nearly perfect reception of everyday connected speech materials can be achieved at near normal speaking rates. To understand the accuracy that might be achieved with automatically generated cues, we measured how well trained spectrogram readers and an automatic speech recognizer could assign cues for various cue systems. We then applied a recently developed model of audiovisual integration to these recognizer measurements and data on human recognition of consonant and vowel segments via speechreading to evaluate the benefit to speechreading provided by such cues. Our analysis suggests that with cues derived from current recognizers, consonant and vowel segments can be received with accuracies in excess of 80%. This level of performance is roughly equivalent to the segment reception accuracy required to account for observed levels of Manual Cued Speech reception. Current recognizers provide maximal benefit by generating only a relatively small number (three to five) of cue groups, and may not provide substantially greater aid to speechreading than simpler aids that do not incorporate discrete phonetic recognition. To provide guidance for the development of improved automatic cueing systems, we describe techniques for determining optimum cue groups for a given recognizer and speechreader, and estimate the cueing performance that might be achieved if the performance of current recognizers were improved.

Intensity perception. XIV. Intensity discrimination in listeners with sensorineural hearing loss.

Intensity discrimination of pulsed tones (also called level discrimination) was measured as a function of level in 13 listeners with sensorineural hearing impairment of primarily cochlear origin, one listener with a vestibular schwannoma, and six listeners with normal hearing. Measurements were also made in normal ears presented with masking noise spectrally shaped to produce audiograms similar to those of the cochlearly impaired listeners. For unilateral impairments, tests were made at the same frequency in the normal and impaired ears. For bilateral-sloping impairments, tests were made at different frequencies in the same ear. The normal listeners showed results similar to other data in the literature. The listener with a vestibular schwannoma showed greatly reduced intensity resolution, except at a few levels. For listeners with recruiting sensorineural impairments, the results are discussed according to the configuration of the impairment and are compared across configurations at equal SPL, equal SL, and equal loudness level. Listeners with increasing hearing losses at frequencies above the test frequency generally showed impaired resolution, especially at high levels, and less deviation from Weber's law than normal listeners. Listeners with decreasing hearing loss at frequencies above the test frequency showed nearly normal intensity-resolution functions. Whereas these trends are generally present, there are also large differences among individuals. Results obtained from normal listeners who were tested in the presence of masking noise indicate that elevated thresholds and reduced dynamic range account for some, but not all, of the effects of recruiting sensorineural impairment on intensity resolution.

Intelligibility of frequency-lowered speech produced by a channel vocoder.

Frequency lowering is a form of signal processing designed to match speech to the residual auditory capacity of a listener with a high frequency hearing loss. A vocoder-based frequency-lowering system similar to one studied by Lippmann was evaluated in the present study. In this system, speech levels in high frequency bands modulated one-third-octave bands of noise at low frequencies, which were then added to unprocessed speech. Results obtained with this system indicated, in agreement with Lippmann, that processing improved the recognition of stop, fricative, and affricate consonants when the listening bandwidth was restricted to 800 Hz. However, results also showed that processing degraded the perception of nasals and semivowels, consonants not included in Lippmann's study. Based on these results, the frequency-lowering system was modified so as to suppress the processing whenever low frequency components dominated the input signal. High and low frequency energies of an input signal were measured continuously in the modified system, and the decision to process or to leave the signal unaltered was based on their relative levels. Results indicated that the modified system maintained the processing advantage for stops, fricatives, and affricates without degrading the perception of nasals and semi-vowels. The results of the present study also indicated that training is an important consideration when evaluating frequency-lowering systems.