Recording Data in all three modules! by kylemath · Pull Request #77 · kylemath/EEGEdu

kylemath · 2019-12-23T07:28:29Z

This addresses the goals of #14
We have a data save button at the end of each page, this uses the current page settings and pipe to save a csv file with each row showing a processed segment of data, the next row shows the next segment.
The output files have unique names for the different modules, and have a column at the start with a unique time code.
The files also have a header saying what is in each row
Record button is only active once connected, and once pressed pops up a window explaining that it is recording and a csv file will download when done

TODO: right now it records for 50 epochs. Currently epochs are 4 seconds long, but user can change that. We probably want to preset a time, or have the user select it from a menu, in minutes, and then convert that to number of epochs depending on the epoch length
.
Frequency spectra:

Raw Data:

…he pipeX$ pipe

…tive rows

…) doesnt work

kylemath · 2019-12-23T07:33:16Z

  const [rawData, setRawData] = useState(emptyChannelData);
  const [spectraData, setSpectraData] = useState(emptyChannelData);
  const [bandsData, setBandsData] = useState(emptyChannelData);
+  const [recordPop, setRecordPop] = useState(false);


for the pop up when recording (modal window)

Nice work getting a modal window pop'ped.

kylemath · 2019-12-23T07:34:29Z

    { label: translations.types.bands, value: translations.types.bands }
  ];

+  function buildPipe(value) {


I did not get the case by case pipe building working in this pull request, but I did move this to a function and have it commented out for now so we can try again in a different branch/PR

case by case pipe building working

Is the assumption that this will significantly improve performance?
Is there an associated issue for this fix?

yes assumption is it will take less memory
#79

kylemath · 2019-12-23T07:35:10Z

  }

+  function saveToCSV(value) {
+    const numSamplesToSave = 50;


this is what we will need to adjust depending on time desired and epoch length

Sampling rate will always be 256Hz unless it is a Muse 1 in which case it will be 220Hz.

So, time desired would be

recording_time_length = num_samples / sample_rate ... right?

it isn't the sampling rate of the EEG, it is the interval between consecutive epochs of data in neurosity pipes

kylemath · 2019-12-23T07:36:37Z

+          next(x) { 
+            dataToSave.push(
+              "Timestamp (ms),",
+              generateXTics(x.info.samplingRate,x.data[0].length,false).map(function(f) {return "ch0_" + f + "ms"}) + ",", 


tediously creating the headers for each csv types

This was for sure the hardest part and you have done great work making it useful for the user. Laudable efforts!

kylemath · 2019-12-23T07:37:02Z

+        break;
+      case translations.types.spectra:
+        //take one sample to get header info
+        localObservable$ = window.multicastSpectra$.pipe(


for the first two we subscribe and take 1 sample to get some info for the header

kylemath · 2019-12-23T07:37:42Z

+
+    localObservable$.subscribe({
+      next(x) { 
+        dataToSave.push(Date.now() + "," + Object.values(x).join(",") + "\n");


push values with commas between them to file

kylemath · 2019-12-23T07:37:53Z

+          dataToSave, 
+          {type: "text/plain;charset=utf-8"}
+        );
+        saveAs(blob, value + "_Recording.csv");


custom names for each module

kylemath · 2019-12-23T07:38:12Z

-        // Build the data source from the data source
+        // Build the data source
+        console.log("Starting to build the data pipes from the data source...");
+        buildPipe(selected);


now we call this function here instead of building each one

kylemath · 2019-12-23T07:38:27Z

  }

- return (
+  function renderRecord() {


This is the record button and popup when it is pressed

kylemath · 2019-12-23T07:39:05Z

+    if (selected === translations.types.intro) {
+      console.log('No record on intro')
+      return null
+    } else if (selected === translations.types.raw) {


if recording raw data there is a suggested setting explained for the user

kylemath · 2019-12-23T07:39:32Z

          <p>
            {specificTranslations.credits1}
-            <a href="http://learn.neurotechedu.com/">NeurotechEdu. </a>
+            <Link url="http://learn.neurotechedu.com/">NeurotechEdu. </Link>


reformatted links for polaris

Are there other links that we will need to change to conform?

kylemath · 2019-12-23T07:40:46Z

-  ).map(function(each_element) {
-    return Number(each_element.toFixed(0));
-  });
+export function generateXTics(srate, duration, reverse = true) {


I added a flag so this could generate increasing or decreasing tics, which we use in the graph as decreasing (default so the old code still works) but in the csv as increasing so false flag is used

Nice default value to a function, and good use of the export function to make it useable elsewhere!

korymath · 2019-12-24T18:03:27Z

Finally getting a chance to run through this PR today with some internet.

korymath

LGTM. Nice work on building out the save functionality.

korymath · 2019-12-24T18:15:33Z

@kylemath Things look good to me and work for each tab. Nice work.

The modal window covers the ploted data, so we lose the neurofeedback aspect of it. Also, I wonder if it is going to be covered,.... should we plause plotting during saving? Or how should that play out?

korymath · 2019-12-24T18:15:59Z

That modal window is so slick. @keyfer is going to lose his mind.

kylemath

ok, so lets merge this one and then focus on how long we record for and what gets shown on the screen when that happens in a new PR, it will likely be different for different module, and a whole new module can now be made by just changing what is on the screen during recording ;)

kylemath added 20 commits December 19, 2019 22:54

added to it

85e40b8

moved record button to bottom of raw and disabled unless connected

cc35f17

added logic so button works on every page and saves some samples of t…

ee769be

…he pipeX$ pipe

bands saving working into csv with headers and time points on consecu…

46b0c13

…tive rows

fixed the headers"

cf98f6a

doesnt work for muse data, adding many logs to find why, seems next(x…

53b2433

…) doesnt work

push

ada713b

woops

7ecdaa8

added file-saver to package.json

53db159

added 10 lines of saving

e37294a

timestamps

cf2ee2f

added date to top row

64f3633

some console logs trying to figure out difference between mock and muse

41877c4

multicast instead of the old pipe worked for real data!

3bb53bd

added modal window popup on record button press

ae12387

fixed link style in intro to polaris style

a08a181

bands case doesnt work, crashes when switching

e88dcf3

adding headers for other data types

d164bbd

extra changes for raw data

e32ed38

comment agreement

d677732

kylemath requested a review from korymath December 23, 2019 07:32

kylemath commented Dec 23, 2019

View reviewed changes

back to intro

6968d05

kylemath commented Dec 23, 2019

View reviewed changes

korymath approved these changes Dec 24, 2019

View reviewed changes

korymath mentioned this pull request Dec 24, 2019

Add Data Save Functionality #14

Closed

kylemath commented Dec 24, 2019

View reviewed changes

kylemath mentioned this pull request Dec 24, 2019

How long to record, what to show during recording, countdown to recording #80

Closed

kylemath merged commit 1c0db33 into master Dec 24, 2019

kylemath deleted the streamsaver2 branch December 24, 2019 18:50

Conversation

kylemath commented Dec 23, 2019 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

kylemath Dec 23, 2019 • edited Loading Uh oh! There was an error while loading. Please reload this page.

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

Choose a reason for hiding this comment

Uh oh!

korymath commented Dec 24, 2019

Uh oh!

korymath left a comment

Choose a reason for hiding this comment

Uh oh!

korymath commented Dec 24, 2019

Uh oh!

korymath commented Dec 24, 2019

Uh oh!

kylemath left a comment

Choose a reason for hiding this comment

Uh oh!

Reviewers

Assignees

Labels

Projects

Milestone

Development

Uh oh!

2 participants

kylemath commented Dec 23, 2019 •

edited

Loading

kylemath Dec 23, 2019 •

edited

Loading