Help with formatting Date/Time string

Share icon

Pretty new user to Igor (running Igor Pro 6.0.5.0 on a site license at work) and I'm having issues converting a date-time string.

The format is YYYY-MM-DDTHH:MM:SS.SSSZ There is also a leading single-space before the year. I could cook this out in Excel and format it, except the files I'm looking to work with are even too big for Excel in some cases (over 1,000,000 rows).

I've tried the "Tweaks" options, but that doesn't seem to get it there. Using smaller files, I've re-formated them in Excel and Igor has succesfully pulled them in, but that was by manually changing the - to /.

I'm still experimenting, found the RemoveByKey command, and some others like SplitString.

Thanks
With this as the text to be loaded:
2014-03-31T12:13:14.567Z
2014-03-31T12:13:14.567Z


this command loads it:
LoadWave/J/D/E=1/B="F=8;"/R={English,2,2,2,2,"Year-Month-DayOfMonth",40} "Clipboard"


If that does not solve the problem then please post a representative section of the actual file to be loaded.

March 31, 2014 at 09:18 am - Permalink

OK, thanks for the quick reply, and that had some success. Using the command "as is", the wave loaded for the date/time group comes up blank. I played with some of the commands and changing the wave type to Date only did result in the wave being the date only, but the time of day seems to disappear.

I've uploaded some sample data. This is as loaded from the other program, including leading blank spaces in the date/time column. Note that I can put the data in any order for the input file (input to Igor that is).

Thanks again
Sample_Data.csv (8.17 KB)

March 31, 2014 at 02:57 pm - Permalink

tcj103 wrote:
Using the command "as is", the wave loaded for the date/time group comes up blank.


This is because LoadWave/J will start loading from the first line (line 0) unless instructed otherwise and line 0 contains text, not date/time data. To make it start loading from the second line (line 1), you need to use the /L flag. I also added /W to have it read the wave names from line 0.

The /B flag which I used before is not needed because LoadWave/J deduces that the first column is date/time given the correct /L and /R flags.

The result is:
LoadWave/J/D/E=1/L={0,1,0,0,0}/W/R={English,2,2,2,2,"Year-Month-DayOfMonth",40} ""

March 31, 2014 at 05:08 pm - Permalink

Update; I still had issues getting it to read correctly, but found I could update to Igor Pro 6.3. Something in 6.3 made it all work better.

Thanks again for the help!

April 2, 2014 at 06:12 pm - Permalink