I tracked the appearance of the clouds according to this methodology, which basically asks that I fill a page of notes for each observation. The instructions were deliberately vague, so when I sat down to code all the data, I started looking for patterns. I first coded it in a table in org-mode in Emacs, which can easily be exported to a number of formats, including tab-separated values. You'll note that I regularized spelling, except for "grey" which I consistently spelled the British way (much prettier, don't you think?); I did not regularize, or rationalize, punctuation and made editorial comments—that is comments while transcribing—in brackets.
This document is in Jupyter Notebook with a Javascript kernel running on my local machine. I'm interested in Jupyter because it allows for literate programming, where I explain my reasoning while using code. At this point, I don't expect to use much Javascript, but I want to get used to the system.
Let's first load a csv parser from npm. The "require" function can apparently load any package available in the npm repository, so it's no problem to load this one.
var csv = require('csv');
csv;
{ generate: { [Function] Generator: { [Function] super_: [Object], ascii: [Function], int: [Function], bool: [Function] } }, parse: { [Function] Parser: { [Function] super_: [Object] } }, transform: { [Function] Transformer: { [Function] super_: [Object] } }, stringify: { [Function] Stringifier: { [Function] super_: [Object] } } }
Now, I don't quite know how this package works, so I'll just try the example code from the website and see what it does:
var fs = require('fs');
var cloud_data = [];
var parser = csv.parse({delimiter: ',', columns: true}, function(err, data){
cloud_data = data;
console.log(data);}
);
fs.createReadStream('2015-11-16-cloud_data.csv').pipe(parser);
cloud_data;
[]
[ { Serial: '1.1:1', Scheduled: '', Observed: '2015-11-01T03:23-05', Present: 'JA, RC', Location: 'Little High, bedroom', Observations: 'No clouds visible, dark & few stars visible, possibly because of the street lights.', Conditions: 'Observed from bed at approximate time, street lights & plate glass window. Somewhat hungover (drunk still?) after a long Halloween party w/ SW & friends' }, { Serial: '1.2:2', Scheduled: '', Observed: '2015-11-01T07:08-05', Present: 'JA, neighbors, passing car', Location: 'Little High, front porch', Observations: '*RAIN!* Nearly uniform grey clouds but sort of milky w/ some purplish sections breaking through.', Conditions: 'Natural light, sirens, hundreads of birds singing, neighbors making dog pee; headache blurry eyes, tired & some what cold, but not uncomfortable' }, { Serial: '1.3:3', Scheduled: '', Observed: '2015-11-01T11:03-05', Present: 'JA, AW, birds, RC, traffic', Location: 'Little High, porch', Observations: 'No rain, slow moving NE, grey & white; looks like a storm; curdled water lumps that look like soft paper disolving in cold water', Conditions: 'RC & AW making fun of the project, clean and heading out to brunch, so I\'m delaying them' }, { Serial: '1.4:4', Scheduled: '2015-11-01T15:00-05', Observed: '2015-11-01T15:00-05', Present: 'JA, birds (RC upstairs)', Location: 'Little High, porch', Observations: 'slow moving w/ sunlight breaking through, mild rumble (thunder?), wl a stillness suggests impending rain; not much blue, nearly black & white, blue-grey, no sky;', Conditions: 'getting read to leave w/ RC, having played Earthbound for an hour' }, { Serial: '1.5:5', Scheduled: '2015-11-01T19:00-05', Observed: '2015-11-01T18:40-05', Present: 'JA, JD, M (BS and Lundy near), crickets', Location: 'Little High, porch & living room', Observations: 'mostly dark sky, with some lighter streaks of cloud; one illuminated by the moon w/ a cool-blue light; one near the western horizon illuminated by orange city (?) light;', Conditions: 'in PJs, RC just left, full, talking w/ JD and tired from a long weekend' }, { Serial: '1.6:6', Scheduled: '2015-11-01T22:30-05', Observed: '2015-11-01T22:30-05', Present: 'JA, BS, Lundy, crickets', Location: 'Little High, bedroom & porch', Observations: 'organge glow near eastern horizon, no stars, black sky, no visible moon (cf. 1.5:5)', Conditions: 'bright lights make the sky hard to see; west has a cooler city glow near the horizon seems to be moisture and mist; tired afte a long day, observations' }, { Serial: '2.1:7', Scheduled: '2015-11-02T03:00-05', Observed: '2015-11-02T03:35-05', Present: 'JA, radio', Location: 'Little High, bed in bedroom', Observations: 'No apparent change, still black, starless w/ no visible clouds;', Conditions: 'a soft humming seems to have developed, woke up from sleep to write notes, so tired, not sure this is a great idea, but did use the rest-room; had odd dreams, but o/w good.' }, { Serial: '2.2:8', Scheduled: '2015-11-02T07:30-05', Observed: '2015-11-02T08:02-05', Present: 'JA, two trash dudes, birds (JD inside)', Location: 'Little High, front porch', Observations: 'smooth, grey, some stripes and clusters to the south west looks like rain: opaque & uniform, north looks marbled, east looks like pollution;', Conditions: 'tired from night observation, JD fussy, no coffee yet, a little cold, but enthusiastic about the project' }, { Serial: '2.3:9', Scheduled: '2015-11-02T12:00-05', Observed: '2015-11-02T12:30-05', Present: 'JA, birds, cars', Location: 'Little High, porch', Observations: 'white & grey tabby pattern w/ diffuse blue-grey light; cotton balls above; hazy to the east; rainy to the west; slowly moving North', Conditions: 'after shopping, making lunch & coffee, put off and hurried' }, { Serial: '2.4:10', Scheduled: '2015-11-02T16:30-05', Observed: '2015-11-02T16:33-05', Present: 'JA, Tia, traffic, crickets', Location: 'Ivy Dental, porch', Observations: 'some deep blue above, grey streaks, a few vapor trails, pool water blue to the west, grey storm to the east; moving slowly south', Conditions: 'post-dentist numb lips, about to bike happy & awake, but pestered' }, { Serial: '2.5:11', Scheduled: '2015-11-0T10:30-05', Observed: '2015-11-02T19:48-05', Present: 'JA, MER, crickets, traffic', Location: 'Little High, sidewalk', Observations: 'purple-grey and ruddy (puce?) large marbling overhead; no orange clouds to the east; mottled to the west;', Conditions: 'full belly, w/ MER, cool, numbing recovering, talking about relationships; street lights, MER really wants to move on; new plan' }, { Serial: '2.6:12', Scheduled: 'before bed', Observed: '2015-11-02T11:30-05', Present: 'JA, crickets', Location: 'Little High, sidewalk', Observations: 'clouds overhead more broken up, visible chunks of purple or navy,; solid to the north, loose to the east; seem stationary;', Conditions: 'tooth aching post-dinner and the return of sensation isn\'t nice; tired, ready to sleep' }, { Serial: '[blank]', Scheduled: '', Observed: '', Present: '', Location: '', Observations: '', Conditions: '' }, { Serial: '3.1:13', Scheduled: 'waking', Observed: '2015-11-03T09:54-05', Present: 'JA, birds, (JD inside), traffic', Location: 'Little High, porch', Observations: 'clear blue skies, no visible clouds, moon above, sun in yellow-orange sky to east, pool-water blue near west horizon, stringy blue north', Conditions: 'just up in PJs, stink eye from JD, cool temperature, moderate school traffic' }, { Serial: '3.2:14', Scheduled: '2015-11-03T11:00-05', Observed: '2015-11-03T10:36-05', Present: 'JA, 8 students, 6 bikes, birds, plane, traffic', Location: 'Nau Hall, circular patio', Observations: 'very clear skies, moon lower in the north, pool water to the west, cobalt above, pool-water near the horizon, really;', Conditions: 'just biked to campus, sitting in patio, awake, sore tooth, prepping for class' }, { Serial: '3.3:15', Scheduled: '2015-11-03T14:30-05', Observed: '2015-11-03T14:27-05', Present: 'JA, ER, JB, PL, LW, 6 students', Location: 'Praxis Lab, through the window', Observations: 'through the window, clear skies, bright sun pool-water color near the horizon, cobalt blue up, no moon,', Conditions: 'but only looking North; in the lab, was late to a meeting, reading email, ER and I are fangirling, Ronda walked in' }, { Serial: '3.4:16', Scheduled: '2015-11-03T18:30-05', Observed: '2015-11-03T18:52-05', Present: 'JA, crickets, car, neighbors, traffic, Rosie, BS', Location: 'Little High, street & porch', Observations: 'clear blue sky, no clouds visible, twinkling stars, blue-black, street lights, little wind, still no clouds', Conditions: 'recently showered, Rosie politely waiting, BS visited, AW coming over, slightly hungry, cool in t-shirt, sitting, after-shave on face' }, { Serial: '3.5:17', Scheduled: '2015-11-03T22:30-05', Observed: '2015-11-03T22:32-05', Present: 'JA, AW, crickets, traffic', Location: 'Little High, porch & street', Observations: 'no clouds, twinkling stars, Orion behind a tree, light on horizon,', Conditions: 'hanging w/ AW, snuggled & had beers, o.w. a quiet night, very mellow, want to play a game' }, { Serial: '3.6:18', Scheduled: 'before bed', Observed: '2015-11-03T23:51-05', Present: 'JA, traffic', Location: 'LIttle High, bedroom', Observations: 'black-grey stky, no stars visible,', Conditions: 'through a window, street light, up late playing Earthbound, which was good, tired and worried about getting enough observations before bed.' }, { Serial: '4.1:19', Scheduled: 'upon waking', Observed: '2015-11-04T07:59-05', Present: 'JA, birds, traffic', Location: 'Little High, porch', Observations: 'few clouds, except to the SE, white light, some grey bottoms and the pool-water horizon;', Conditions: 'a bit chilly out, lots of birds singing. I feel like I slept in, but apparently not (only 8 hours) could have 5 am' }, { Serial: '4.2:20', Scheduled: '2015-11-04T11:30-05', Observed: '2015-11-04T11:00-05', Present: 'JA, traffic, music, outside', Location: 'Little High, desk, bedroom', Observations: 'very clear still, cloudy on eastern horizon in strips, white near the pool-water blue, also southern too, clear bright, white;', Conditions: 'substituting early observation because of last night\'s pile-up and finishing a task: a reward' }, { Serial: '4.3:21', Scheduled: '2015-11-04T14:00-05', Observed: '2015-11-04T14:04-05', Present: 'JA, traffic, construction, neighbor raking, children', Location: 'Little High, porch & street', Observations: 'wispy clouds E,S,W, for E grey and low, S are little streaks of pure, white, W is billowing large clouds, N is deep blue;', Conditions: 'just patch pants & finished a book, _hot_, EH coming over shortly' }, { Serial: '4.4:22', Scheduled: '2015-11-04T18:00-05', Observed: '2015-11-04T17:22-05', Present: 'JA, EH, traffic, birds, crickets, children playing, neighbors, squirrel', Location: 'Little High, sidewalk', Observations: 'grey, falling light, low, light grey to dark, bluish grey east light breaking through in west', Conditions: 'walked around all day, EH assisting [with observation], street lights on, sun light around, around 60 degrees Fahrenheit, sun not visible' }, { Serial: '4.5:23', Scheduled: '2015-11-04T10:30-05', Observed: '2015-11-04T21:01-05', Present: 'JA, crickets, traffic, ER', Location: 'Little High, sidewalk', Observations: 'light purple & dark blue clouds, few stars, solid purples eastern, solid grey purple west, mottled north, deep blue south;', Conditions: 'full belly, having played games & caught up w/ ER & EH' }, { Serial: '4.6:24', Scheduled: 'before bed', Observed: '2015-11-04T23:59-05', Present: 'JA, crickets, traffic', Location: 'Little High, bed-window', Observations: 'purple grey clouds on a dark navy sky, street light, few stars;', Conditions: 'after setting up and playing a little Earthbound at home and getting ready for trip to NYC to go to the workshop' }, { Serial: '5.1:25', Scheduled: 'waking ( ca. 2015-11-05T06:00-05 )', Observed: '2015-11-05T06:42-05', Present: 'JA, birds, radio, traffic', Location: 'Little High, porch', Observations: 'multi-color stripes to the east, dull-flat-grey to the west, south is a lightly ribbed grey-velvet mix, sun is rising on medium cover;', Conditions: 'just woken up, in jacket and jeans, worried about making the train on time' }, { Serial: '5.2:26', Scheduled: '2015-11-05T09:30-05', Observed: '2015-11-05T10:26-05', Present: 'JA, passengers, trains, BH', Location: 'Train just past Manasses', Observations: 'south widwon; wispy clouds in white along horizon reaching to a blue sky above;', Conditions: 'extremely limited range of viewing, but on a comfortable seat and working on laptop while reading, BH near' }, { Serial: '5.3:27', Scheduled: '2015-11-05T12:30-05', Observed: '2015-11-05T12:13-05', Present: 'JA, quiet car, _many_ more passengers', Location: 'NE of Washington DC, on train', Observations: 'SE window: brown-grey haze, no clouds, dirty looking light swirling blackish clouds up, not much NW, but hazy too;', Conditions: 'in train w/ even more people as we travel, waiting to get lunch' }, { Serial: '5.4:28', Scheduled: '2015-11-05T15:30-05', Observed: '2015-11-05T14:24-05', Present: 'JA, passengers, train', Location: 'Trenton, NJ, train station', Observations: 'raining, sky reflected on surfaces at station as seen through the window of the train, grey-blue overcast; hint of aqua', Conditions: 'finished computer work, lady sitting by me, re-checked ticket, had weird lunch' }, { Serial: '5.5:29', Scheduled: '2015-11-05T18:30-05', Observed: '2015-11-05T18:30-05', Present: 'JA, traffic, people on the street', Location: 'Giovanni\'s place, NYC, W 44th St.', Observations: 'looking N out a window over buildings, black-orange haze, slight rain, glistening sidewalks;', Conditions: 'having read about Emacs & text all day ridden a train, managet to get into Giovanni\'s house' }, { Serial: '5.6:30', Scheduled: 'before bed', Observed: '2015-11-05T22:05-05', Present: 'JA, traffic, pedestrians', Location: 'Giovanni\'s place', Observations: 'grey-purples quite bright, light from street, no stars, spot light creame in parts, just N over buildings;', Conditions: 'post shower, drinked with Ali, quite tired and ready for bed, feeling good though' }, { Serial: '6.1:31', Scheduled: 'awaking', Observed: '2015-11-06T07:30-05', Present: 'JA, traffic, siren, Frank', Location: 'Giovanni\'s place, out the window', Observations: 'gre skies gradient from smoke grey to pale white, some cracks to blueish, above, bubbly, round;', Conditions: 'just awake, dressed, watering eyes, tired, but happy, hearing voices in the hallway' }, { Serial: '6.2:32', Scheduled: '2015-11-06T10:30-05', Observed: '2015-11-06T10:25-05', Present: 'JA, traffic, construction, dude on phone', Location: 'Grolier Club, front porch', Observations: 'fast moving, low clouds to the west through buildings, white & blue, above grey & white, fast moving;', Conditions: 'having looked at the exhibit and now standing outside, saw some friends and hung out' }, { Serial: '6.3:33', Scheduled: '2015-11-06T13:30-05', Observed: '2015-11-06T13:42-05', Present: 'JA, traffic, construction, people', Location: 'Gene\'s Coffe Shop, porch', Observations: 'fast, low clouds, slight haze to the west, bright sunlight & warm;', Conditions: 'hungry having looked at books for awhile and ready for conference' }, { Serial: '6.4:34', Scheduled: '2015-11-06T16:30-05', Observed: '2015-11-06T17:03-05', Present: 'JA, people, traffic', Location: 'Along 44th St., on sidewalk', Observations: 'hazy and humid, clouds close in', Conditions: 'totally memorial reconstruction' }, { Serial: '6.5:35', Scheduled: '2015-11-06T18:30-05', Observed: '2015-11-06T18:30-05', Present: 'JA, so many people!', Location: 'street somewhere near Harvard Club', Observations: 'nothing, too many people', Conditions: '[apparently written in some haste and despair]' }, { Serial: '[blank]', Scheduled: '', Observed: '', Present: '', Location: '', Observations: '', Conditions: '' }, { Serial: '6.6:36', Scheduled: '', Observed: '2015-11-06T20:34-05', Present: 'JA, people, traffic, siren', Location: 'Giovanni\'s place', Observations: 'grey & dark blue, slow moving, breaking clouds, grey cap over navy horizon;', Conditions: 'full belly & tired but okay and ready for bed' }, { Serial: '7.1:37', Scheduled: 'waking', Observed: '2015-11-07T07:27-05', Present: 'JA, traffic, people', Location: 'Giovanni\'s 4th floor', Observations: 'dishwater grey-blue & tight grey-white streaked together, moving slowly, not fast, seem low, beautiful streaking up;', Conditions: 'just waknig up, feeling groggy as I slept 11 hours or so, but I think it was good' }, { Serial: '7.2:38', Scheduled: '2015-11-07T10:00-05', Observed: '2015-11-07T09:50-05', Present: 'JA, traffic, construction, dude crossing the street, etc.', Location: 'Grolier Club, porch', Observations: 'uniformish, grey & white, smooth colors, medium fast moving, light grey blue, etc. west a little orange at horizon;', Conditions: 'snuck out of conference, rushed' }, { Serial: '7.3:39', Scheduled: '2015-11-07T12:00-05', Observed: '2015-11-07T11:00-05', Present: 'JA, conference smokers, traffic, construction', Location: 'Grolier Club, porch', Observations: 'uniform gradient from white above to blueish near horizon, then grey below, then a white streaking think scalloped horizon;', Conditions: 'break at talk, saw LO, wants award' }, { Serial: '7.4:34', Scheduled: '2015-11-07T15:00-05', Observed: '2015-11-07T13:00-05', Present: 'JA, traffic, people, construction, LO, ES', Location: 'Grolier Club, porch', Observations: 'white-grey, bright clouds, darkening toward horizon, low lines of blue; moderate speed about 45 degrees up;', Conditions: 'after lecture grabbing lunch, but o.w. feeling awake & fine' }, { Serial: '7.5:35', Scheduled: '2015-11-07T17:00-05', Observed: '2015-11-07T18:10-05', Present: 'JA, LO, traffic, people, dogs, horses', Location: 'Central Park', Observations: 'dark blue sky, no easily visible stars, fast walking in the cool air, no sense of rain;', Conditions: 'having finished a conference on Provenance & catching up w/ LO' }, { Serial: '7.6:36', Scheduled: '', Observed: '2015-11-07T20:40-05', Present: 'JA, traffic, people', Location: 'Giovanni\'s window', Observations: 'purple grey clouds, w/ pale but not deep blue ground, lumpy, chunks but not strings, or clods; breaking up toward horizon;', Conditions: 'sorta wanna go out, but feel like I should stay in' } ]
Okay, so the code is slightly tweaked from this example, in the obvious ways, but is now loading the csv file and passing it to a parser that knows to cut it up at the commas and puts it in cloud_data. You can see that it's a labeled object, so let's look at the first row.
cloud_data[0];
{ Serial: '1.1:1', Scheduled: '', Observed: '2015-11-01T03:23-05', Present: 'JA, RC', Location: 'Little High, bedroom', Observations: 'No clouds visible, dark & few stars visible, possibly because of the street lights.', Conditions: 'Observed from bed at approximate time, street lights & plate glass window. Somewhat hungover (drunk still?) after a long Halloween party w/ SW & friends' }
So, let's imagine that I can make a package to automatically find the latitude and longitude of the "Location" listed in these. I'd have to iterate over all the Locations within each row. Let's see if I can make a list
var locations = [];
for (eachRow in cloud_data) {
locations.push(cloud_data[eachRow].Location);
}
console.log(locations);
[ 'Little High, bedroom', 'Little High, front porch', 'Little High, porch', 'Little High, porch', 'Little High, porch & living room', 'Little High, bedroom & porch', 'Little High, bed in bedroom', 'Little High, front porch', 'Little High, porch', 'Ivy Dental, porch', 'Little High, sidewalk', 'Little High, sidewalk', '', 'Little High, porch', 'Nau Hall, circular patio', 'Praxis Lab, through the window', 'Little High, street & porch', 'Little High, porch & street', 'LIttle High, bedroom', 'Little High, porch', 'Little High, desk, bedroom', 'Little High, porch & street', 'Little High, sidewalk', 'Little High, sidewalk', 'Little High, bed-window', 'Little High, porch', 'Train just past Manasses', 'NE of Washington DC, on train', 'Trenton, NJ, train station', 'Giovanni\'s place, NYC, W 44th St.', 'Giovanni\'s place', 'Giovanni\'s place, out the window', 'Grolier Club, front porch', 'Gene\'s Coffe Shop, porch', 'Along 44th St., on sidewalk', 'street somewhere near Harvard Club', '', 'Giovanni\'s place', 'Giovanni\'s 4th floor', 'Grolier Club, porch', 'Grolier Club, porch', 'Grolier Club, porch', 'Central Park', 'Giovanni\'s window' ]
undefined
That's pretty cool, I can see that the quotes are escpaed out, which seems like a good idea. I wonder if that will cause problems later. Now, on some of the records, we have no scheduled time; let's say that if I didn't schedule a time, then the scheduled time is the time I made the observation. This makes sense to me, since if I didn't bother to schedule it, I must have meant "do it whenever."
for (eachRowIndex in cloud_data) {
if (cloud_data[eachRowIndex].Scheduled === "") {
cloud_data[eachRowIndex].Scheduled = cloud_data[eachRowIndex].Observed;
}
console.log("Sched: ", cloud_data[eachRowIndex].Scheduled, " Obsv: ", cloud_data[eachRowIndex].Observed);
}
Sched: 2015-11-01T03:23-05 Obsv: 2015-11-01T03:23-05 Sched: 2015-11-01T07:08-05 Obsv: 2015-11-01T07:08-05 Sched: 2015-11-01T11:03-05 Obsv: 2015-11-01T11:03-05 Sched: 2015-11-01T15:00-05 Obsv: 2015-11-01T15:00-05 Sched: 2015-11-01T19:00-05 Obsv: 2015-11-01T18:40-05 Sched: 2015-11-01T22:30-05 Obsv: 2015-11-01T22:30-05 Sched: 2015-11-02T03:00-05 Obsv: 2015-11-02T03:35-05 Sched: 2015-11-02T07:30-05 Obsv: 2015-11-02T08:02-05 Sched: 2015-11-02T12:00-05 Obsv: 2015-11-02T12:30-05 Sched: 2015-11-02T16:30-05 Obsv: 2015-11-02T16:33-05 Sched: 2015-11-0T10:30-05 Obsv: 2015-11-02T19:48-05 Sched: before bed Obsv: 2015-11-02T11:30-05 Sched: Obsv: Sched: waking Obsv: 2015-11-03T09:54-05 Sched: 2015-11-03T11:00-05 Obsv: 2015-11-03T10:36-05 Sched: 2015-11-03T14:30-05 Obsv: 2015-11-03T14:27-05 Sched: 2015-11-03T18:30-05 Obsv: 2015-11-03T18:52-05 Sched: 2015-11-03T22:30-05 Obsv: 2015-11-03T22:32-05 Sched: before bed Obsv: 2015-11-03T23:51-05 Sched: upon waking Obsv: 2015-11-04T07:59-05 Sched: 2015-11-04T11:30-05 Obsv: 2015-11-04T11:00-05 Sched: 2015-11-04T14:00-05 Obsv: 2015-11-04T14:04-05 Sched: 2015-11-04T18:00-05 Obsv: 2015-11-04T17:22-05 Sched: 2015-11-04T10:30-05 Obsv: 2015-11-04T21:01-05 Sched: before bed Obsv: 2015-11-04T23:59-05 Sched: waking ( ca. 2015-11-05T06:00-05 ) Obsv: 2015-11-05T06:42-05 Sched: 2015-11-05T09:30-05 Obsv: 2015-11-05T10:26-05 Sched: 2015-11-05T12:30-05 Obsv: 2015-11-05T12:13-05 Sched: 2015-11-05T15:30-05 Obsv: 2015-11-05T14:24-05 Sched: 2015-11-05T18:30-05 Obsv: 2015-11-05T18:30-05 Sched: before bed Obsv: 2015-11-05T22:05-05 Sched: awaking Obsv: 2015-11-06T07:30-05 Sched: 2015-11-06T10:30-05 Obsv: 2015-11-06T10:25-05 Sched: 2015-11-06T13:30-05 Obsv: 2015-11-06T13:42-05 Sched: 2015-11-06T16:30-05 Obsv: 2015-11-06T17:03-05 Sched: 2015-11-06T18:30-05 Obsv: 2015-11-06T18:30-05 Sched: Obsv: Sched: 2015-11-06T20:34-05 Obsv: 2015-11-06T20:34-05 Sched: waking Obsv: 2015-11-07T07:27-05 Sched: 2015-11-07T10:00-05 Obsv: 2015-11-07T09:50-05 Sched: 2015-11-07T12:00-05 Obsv: 2015-11-07T11:00-05 Sched: 2015-11-07T15:00-05 Obsv: 2015-11-07T13:00-05 Sched: 2015-11-07T17:00-05 Obsv: 2015-11-07T18:10-05 Sched: 2015-11-07T20:40-05 Obsv: 2015-11-07T20:40-05
undefined
Now, I notice that there are two blank entries and I remember that my transcription had two blank pages. Let's drop those from the cloud_data object.
for (eachRowIndex in cloud_data) {
if (cloud_data[eachRowIndex].Scheduled === "") {
delete cloud_data[eachRowIndex];
}
}
cloud_data;
[ { Serial: '1.1:1', Scheduled: '2015-11-01T03:23-05', Observed: '2015-11-01T03:23-05', Present: 'JA, RC', Location: 'Little High, bedroom', Observations: 'No clouds visible, dark & few stars visible, possibly because of the street lights.', Conditions: 'Observed from bed at approximate time, street lights & plate glass window. Somewhat hungover (drunk still?) after a long Halloween party w/ SW & friends' }, { Serial: '1.2:2', Scheduled: '2015-11-01T07:08-05', Observed: '2015-11-01T07:08-05', Present: 'JA, neighbors, passing car', Location: 'Little High, front porch', Observations: '*RAIN!* Nearly uniform grey clouds but sort of milky w/ some purplish sections breaking through.', Conditions: 'Natural light, sirens, hundreads of birds singing, neighbors making dog pee; headache blurry eyes, tired & some what cold, but not uncomfortable' }, { Serial: '1.3:3', Scheduled: '2015-11-01T11:03-05', Observed: '2015-11-01T11:03-05', Present: 'JA, AW, birds, RC, traffic', Location: 'Little High, porch', Observations: 'No rain, slow moving NE, grey & white; looks like a storm; curdled water lumps that look like soft paper disolving in cold water', Conditions: 'RC & AW making fun of the project, clean and heading out to brunch, so I\'m delaying them' }, { Serial: '1.4:4', Scheduled: '2015-11-01T15:00-05', Observed: '2015-11-01T15:00-05', Present: 'JA, birds (RC upstairs)', Location: 'Little High, porch', Observations: 'slow moving w/ sunlight breaking through, mild rumble (thunder?), wl a stillness suggests impending rain; not much blue, nearly black & white, blue-grey, no sky;', Conditions: 'getting read to leave w/ RC, having played Earthbound for an hour' }, { Serial: '1.5:5', Scheduled: '2015-11-01T19:00-05', Observed: '2015-11-01T18:40-05', Present: 'JA, JD, M (BS and Lundy near), crickets', Location: 'Little High, porch & living room', Observations: 'mostly dark sky, with some lighter streaks of cloud; one illuminated by the moon w/ a cool-blue light; one near the western horizon illuminated by orange city (?) light;', Conditions: 'in PJs, RC just left, full, talking w/ JD and tired from a long weekend' }, { Serial: '1.6:6', Scheduled: '2015-11-01T22:30-05', Observed: '2015-11-01T22:30-05', Present: 'JA, BS, Lundy, crickets', Location: 'Little High, bedroom & porch', Observations: 'organge glow near eastern horizon, no stars, black sky, no visible moon (cf. 1.5:5)', Conditions: 'bright lights make the sky hard to see; west has a cooler city glow near the horizon seems to be moisture and mist; tired afte a long day, observations' }, { Serial: '2.1:7', Scheduled: '2015-11-02T03:00-05', Observed: '2015-11-02T03:35-05', Present: 'JA, radio', Location: 'Little High, bed in bedroom', Observations: 'No apparent change, still black, starless w/ no visible clouds;', Conditions: 'a soft humming seems to have developed, woke up from sleep to write notes, so tired, not sure this is a great idea, but did use the rest-room; had odd dreams, but o/w good.' }, { Serial: '2.2:8', Scheduled: '2015-11-02T07:30-05', Observed: '2015-11-02T08:02-05', Present: 'JA, two trash dudes, birds (JD inside)', Location: 'Little High, front porch', Observations: 'smooth, grey, some stripes and clusters to the south west looks like rain: opaque & uniform, north looks marbled, east looks like pollution;', Conditions: 'tired from night observation, JD fussy, no coffee yet, a little cold, but enthusiastic about the project' }, { Serial: '2.3:9', Scheduled: '2015-11-02T12:00-05', Observed: '2015-11-02T12:30-05', Present: 'JA, birds, cars', Location: 'Little High, porch', Observations: 'white & grey tabby pattern w/ diffuse blue-grey light; cotton balls above; hazy to the east; rainy to the west; slowly moving North', Conditions: 'after shopping, making lunch & coffee, put off and hurried' }, { Serial: '2.4:10', Scheduled: '2015-11-02T16:30-05', Observed: '2015-11-02T16:33-05', Present: 'JA, Tia, traffic, crickets', Location: 'Ivy Dental, porch', Observations: 'some deep blue above, grey streaks, a few vapor trails, pool water blue to the west, grey storm to the east; moving slowly south', Conditions: 'post-dentist numb lips, about to bike happy & awake, but pestered' }, { Serial: '2.5:11', Scheduled: '2015-11-0T10:30-05', Observed: '2015-11-02T19:48-05', Present: 'JA, MER, crickets, traffic', Location: 'Little High, sidewalk', Observations: 'purple-grey and ruddy (puce?) large marbling overhead; no orange clouds to the east; mottled to the west;', Conditions: 'full belly, w/ MER, cool, numbing recovering, talking about relationships; street lights, MER really wants to move on; new plan' }, { Serial: '2.6:12', Scheduled: 'before bed', Observed: '2015-11-02T11:30-05', Present: 'JA, crickets', Location: 'Little High, sidewalk', Observations: 'clouds overhead more broken up, visible chunks of purple or navy,; solid to the north, loose to the east; seem stationary;', Conditions: 'tooth aching post-dinner and the return of sensation isn\'t nice; tired, ready to sleep' }, , { Serial: '3.1:13', Scheduled: 'waking', Observed: '2015-11-03T09:54-05', Present: 'JA, birds, (JD inside), traffic', Location: 'Little High, porch', Observations: 'clear blue skies, no visible clouds, moon above, sun in yellow-orange sky to east, pool-water blue near west horizon, stringy blue north', Conditions: 'just up in PJs, stink eye from JD, cool temperature, moderate school traffic' }, { Serial: '3.2:14', Scheduled: '2015-11-03T11:00-05', Observed: '2015-11-03T10:36-05', Present: 'JA, 8 students, 6 bikes, birds, plane, traffic', Location: 'Nau Hall, circular patio', Observations: 'very clear skies, moon lower in the north, pool water to the west, cobalt above, pool-water near the horizon, really;', Conditions: 'just biked to campus, sitting in patio, awake, sore tooth, prepping for class' }, { Serial: '3.3:15', Scheduled: '2015-11-03T14:30-05', Observed: '2015-11-03T14:27-05', Present: 'JA, ER, JB, PL, LW, 6 students', Location: 'Praxis Lab, through the window', Observations: 'through the window, clear skies, bright sun pool-water color near the horizon, cobalt blue up, no moon,', Conditions: 'but only looking North; in the lab, was late to a meeting, reading email, ER and I are fangirling, Ronda walked in' }, { Serial: '3.4:16', Scheduled: '2015-11-03T18:30-05', Observed: '2015-11-03T18:52-05', Present: 'JA, crickets, car, neighbors, traffic, Rosie, BS', Location: 'Little High, street & porch', Observations: 'clear blue sky, no clouds visible, twinkling stars, blue-black, street lights, little wind, still no clouds', Conditions: 'recently showered, Rosie politely waiting, BS visited, AW coming over, slightly hungry, cool in t-shirt, sitting, after-shave on face' }, { Serial: '3.5:17', Scheduled: '2015-11-03T22:30-05', Observed: '2015-11-03T22:32-05', Present: 'JA, AW, crickets, traffic', Location: 'Little High, porch & street', Observations: 'no clouds, twinkling stars, Orion behind a tree, light on horizon,', Conditions: 'hanging w/ AW, snuggled & had beers, o.w. a quiet night, very mellow, want to play a game' }, { Serial: '3.6:18', Scheduled: 'before bed', Observed: '2015-11-03T23:51-05', Present: 'JA, traffic', Location: 'LIttle High, bedroom', Observations: 'black-grey stky, no stars visible,', Conditions: 'through a window, street light, up late playing Earthbound, which was good, tired and worried about getting enough observations before bed.' }, { Serial: '4.1:19', Scheduled: 'upon waking', Observed: '2015-11-04T07:59-05', Present: 'JA, birds, traffic', Location: 'Little High, porch', Observations: 'few clouds, except to the SE, white light, some grey bottoms and the pool-water horizon;', Conditions: 'a bit chilly out, lots of birds singing. I feel like I slept in, but apparently not (only 8 hours) could have 5 am' }, { Serial: '4.2:20', Scheduled: '2015-11-04T11:30-05', Observed: '2015-11-04T11:00-05', Present: 'JA, traffic, music, outside', Location: 'Little High, desk, bedroom', Observations: 'very clear still, cloudy on eastern horizon in strips, white near the pool-water blue, also southern too, clear bright, white;', Conditions: 'substituting early observation because of last night\'s pile-up and finishing a task: a reward' }, { Serial: '4.3:21', Scheduled: '2015-11-04T14:00-05', Observed: '2015-11-04T14:04-05', Present: 'JA, traffic, construction, neighbor raking, children', Location: 'Little High, porch & street', Observations: 'wispy clouds E,S,W, for E grey and low, S are little streaks of pure, white, W is billowing large clouds, N is deep blue;', Conditions: 'just patch pants & finished a book, _hot_, EH coming over shortly' }, { Serial: '4.4:22', Scheduled: '2015-11-04T18:00-05', Observed: '2015-11-04T17:22-05', Present: 'JA, EH, traffic, birds, crickets, children playing, neighbors, squirrel', Location: 'Little High, sidewalk', Observations: 'grey, falling light, low, light grey to dark, bluish grey east light breaking through in west', Conditions: 'walked around all day, EH assisting [with observation], street lights on, sun light around, around 60 degrees Fahrenheit, sun not visible' }, { Serial: '4.5:23', Scheduled: '2015-11-04T10:30-05', Observed: '2015-11-04T21:01-05', Present: 'JA, crickets, traffic, ER', Location: 'Little High, sidewalk', Observations: 'light purple & dark blue clouds, few stars, solid purples eastern, solid grey purple west, mottled north, deep blue south;', Conditions: 'full belly, having played games & caught up w/ ER & EH' }, { Serial: '4.6:24', Scheduled: 'before bed', Observed: '2015-11-04T23:59-05', Present: 'JA, crickets, traffic', Location: 'Little High, bed-window', Observations: 'purple grey clouds on a dark navy sky, street light, few stars;', Conditions: 'after setting up and playing a little Earthbound at home and getting ready for trip to NYC to go to the workshop' }, { Serial: '5.1:25', Scheduled: 'waking ( ca. 2015-11-05T06:00-05 )', Observed: '2015-11-05T06:42-05', Present: 'JA, birds, radio, traffic', Location: 'Little High, porch', Observations: 'multi-color stripes to the east, dull-flat-grey to the west, south is a lightly ribbed grey-velvet mix, sun is rising on medium cover;', Conditions: 'just woken up, in jacket and jeans, worried about making the train on time' }, { Serial: '5.2:26', Scheduled: '2015-11-05T09:30-05', Observed: '2015-11-05T10:26-05', Present: 'JA, passengers, trains, BH', Location: 'Train just past Manasses', Observations: 'south widwon; wispy clouds in white along horizon reaching to a blue sky above;', Conditions: 'extremely limited range of viewing, but on a comfortable seat and working on laptop while reading, BH near' }, { Serial: '5.3:27', Scheduled: '2015-11-05T12:30-05', Observed: '2015-11-05T12:13-05', Present: 'JA, quiet car, _many_ more passengers', Location: 'NE of Washington DC, on train', Observations: 'SE window: brown-grey haze, no clouds, dirty looking light swirling blackish clouds up, not much NW, but hazy too;', Conditions: 'in train w/ even more people as we travel, waiting to get lunch' }, { Serial: '5.4:28', Scheduled: '2015-11-05T15:30-05', Observed: '2015-11-05T14:24-05', Present: 'JA, passengers, train', Location: 'Trenton, NJ, train station', Observations: 'raining, sky reflected on surfaces at station as seen through the window of the train, grey-blue overcast; hint of aqua', Conditions: 'finished computer work, lady sitting by me, re-checked ticket, had weird lunch' }, { Serial: '5.5:29', Scheduled: '2015-11-05T18:30-05', Observed: '2015-11-05T18:30-05', Present: 'JA, traffic, people on the street', Location: 'Giovanni\'s place, NYC, W 44th St.', Observations: 'looking N out a window over buildings, black-orange haze, slight rain, glistening sidewalks;', Conditions: 'having read about Emacs & text all day ridden a train, managet to get into Giovanni\'s house' }, { Serial: '5.6:30', Scheduled: 'before bed', Observed: '2015-11-05T22:05-05', Present: 'JA, traffic, pedestrians', Location: 'Giovanni\'s place', Observations: 'grey-purples quite bright, light from street, no stars, spot light creame in parts, just N over buildings;', Conditions: 'post shower, drinked with Ali, quite tired and ready for bed, feeling good though' }, { Serial: '6.1:31', Scheduled: 'awaking', Observed: '2015-11-06T07:30-05', Present: 'JA, traffic, siren, Frank', Location: 'Giovanni\'s place, out the window', Observations: 'gre skies gradient from smoke grey to pale white, some cracks to blueish, above, bubbly, round;', Conditions: 'just awake, dressed, watering eyes, tired, but happy, hearing voices in the hallway' }, { Serial: '6.2:32', Scheduled: '2015-11-06T10:30-05', Observed: '2015-11-06T10:25-05', Present: 'JA, traffic, construction, dude on phone', Location: 'Grolier Club, front porch', Observations: 'fast moving, low clouds to the west through buildings, white & blue, above grey & white, fast moving;', Conditions: 'having looked at the exhibit and now standing outside, saw some friends and hung out' }, { Serial: '6.3:33', Scheduled: '2015-11-06T13:30-05', Observed: '2015-11-06T13:42-05', Present: 'JA, traffic, construction, people', Location: 'Gene\'s Coffe Shop, porch', Observations: 'fast, low clouds, slight haze to the west, bright sunlight & warm;', Conditions: 'hungry having looked at books for awhile and ready for conference' }, { Serial: '6.4:34', Scheduled: '2015-11-06T16:30-05', Observed: '2015-11-06T17:03-05', Present: 'JA, people, traffic', Location: 'Along 44th St., on sidewalk', Observations: 'hazy and humid, clouds close in', Conditions: 'totally memorial reconstruction' }, { Serial: '6.5:35', Scheduled: '2015-11-06T18:30-05', Observed: '2015-11-06T18:30-05', Present: 'JA, so many people!', Location: 'street somewhere near Harvard Club', Observations: 'nothing, too many people', Conditions: '[apparently written in some haste and despair]' }, , { Serial: '6.6:36', Scheduled: '2015-11-06T20:34-05', Observed: '2015-11-06T20:34-05', Present: 'JA, people, traffic, siren', Location: 'Giovanni\'s place', Observations: 'grey & dark blue, slow moving, breaking clouds, grey cap over navy horizon;', Conditions: 'full belly & tired but okay and ready for bed' }, { Serial: '7.1:37', Scheduled: 'waking', Observed: '2015-11-07T07:27-05', Present: 'JA, traffic, people', Location: 'Giovanni\'s 4th floor', Observations: 'dishwater grey-blue & tight grey-white streaked together, moving slowly, not fast, seem low, beautiful streaking up;', Conditions: 'just waknig up, feeling groggy as I slept 11 hours or so, but I think it was good' }, { Serial: '7.2:38', Scheduled: '2015-11-07T10:00-05', Observed: '2015-11-07T09:50-05', Present: 'JA, traffic, construction, dude crossing the street, etc.', Location: 'Grolier Club, porch', Observations: 'uniformish, grey & white, smooth colors, medium fast moving, light grey blue, etc. west a little orange at horizon;', Conditions: 'snuck out of conference, rushed' }, { Serial: '7.3:39', Scheduled: '2015-11-07T12:00-05', Observed: '2015-11-07T11:00-05', Present: 'JA, conference smokers, traffic, construction', Location: 'Grolier Club, porch', Observations: 'uniform gradient from white above to blueish near horizon, then grey below, then a white streaking think scalloped horizon;', Conditions: 'break at talk, saw LO, wants award' }, { Serial: '7.4:34', Scheduled: '2015-11-07T15:00-05', Observed: '2015-11-07T13:00-05', Present: 'JA, traffic, people, construction, LO, ES', Location: 'Grolier Club, porch', Observations: 'white-grey, bright clouds, darkening toward horizon, low lines of blue; moderate speed about 45 degrees up;', Conditions: 'after lecture grabbing lunch, but o.w. feeling awake & fine' }, { Serial: '7.5:35', Scheduled: '2015-11-07T17:00-05', Observed: '2015-11-07T18:10-05', Present: 'JA, LO, traffic, people, dogs, horses', Location: 'Central Park', Observations: 'dark blue sky, no easily visible stars, fast walking in the cool air, no sense of rain;', Conditions: 'having finished a conference on Provenance & catching up w/ LO' }, { Serial: '7.6:36', Scheduled: '2015-11-07T20:40-05', Observed: '2015-11-07T20:40-05', Present: 'JA, traffic, people', Location: 'Giovanni\'s window', Observations: 'purple grey clouds, w/ pale but not deep blue ground, lumpy, chunks but not strings, or clods; breaking up toward horizon;', Conditions: 'sorta wanna go out, but feel like I should stay in' } ]
Okay, so now I've changed entries, added new records, and deleted bad records. It seems to me I have everything I need to massage this data into some sort of format that a visualization function can use, so I'll set this aside for today.