APPENDIX B: FILE FORMATS

Revisions

Leg Initials Date

Indented revision notes. If this file undergoes revisions, copy the original to a new file named for the leg on which the revisions first applied (e.g., PMAG FILE FORMATS.030.html). Only information for that leg is documented.

194 dmaf 1/31/2001

Alternate Treatment comment field is a line by itself (line 6) rather than an appendage of line 5 as previously documented. Actual Long Core program output has been this way for many legs previous. Line 5 may contain the lone text NONE; indicating that no treatment was applied on that sample run. In this case the second and third fields are NOT output, nor are the intervening tabs. Corrected documented file naming standard. File naming convention changed, circa Leg 181, to allow for six-digit run numbers.

File Naming Conventions

CMnnnnnn.DATCMnnnnnn.TRY
• Where nnnnnn is a zero-padded run number.
• DAT files contain calibration data in the file header and sample data in the file body. At present only files of this type have their content loaded into the central database. The sample data may be for either discrete samples (archive or working half) or for continuous sections of core. The LONG CORE program allows the distinct data sets to be separated automatically into two different storage locations. The same file format definitions apply to both sets of files.
• TRY files contain additional calibration data. These are NOT currently loaded into the central database.
CMnnnnnn.DAT Files
• File format implemented in software system Long Core (v191) by source modules named Long Core Header Writer.vi and Long Core Data Writer.vi.
• Data upload supported by Generic Uploader (v192) by modules first deployed for production use on leg 194: pmag.cfg, pmag\dat.cfg, pmag\dat.sql.
• Data edits for routine or procedural errors supported by CryoEdit (v194). Upload capabilities removed from this program; superseded by Generic Uploader.
• Data reporting supported by JanusWeb modules Cryomagnetometer and Z-Plot: http://janusaxp.tamu.edu/predef_queries/links/links_all.shtml
• Standard shipboard storage paths for raw files (DATA1): r:\janus_q\cryo_mag\continuous, r:\janus_q\cryo_mag\discrete. These subdirectories are further subdivided by hole, e.g. 1192a\.
• Standard shore archival storage paths for raw files (PRIME DATA): p:\Prime Data\14a Paleomag\leg\cryo_mag\...

Table AT1. Long Core data matrix for DAT files (from Technical Note 37 [ODP Information Technology and Data Services, 2007]).

File line
Field name
Field
format
Content (Long Core notes)
Database and upload notes
1 run_number 6 zero-padded 6-digit whole number Uploads to pmag_run_num of pmag_run, pmag_run_data, and pmag_section_data.

run_date_time 13 mm/dd/yy hhmi In SQL use to_date format mm/dd/rr hh24mi. rr accomodates appropriate handling of 4-digit years. pmag_calib.pmag_calib_date_time
2 system_id 20 CRYO | SPINNER Value ignored by uploader, hard-coded as pmag_run.system_id=1
3 run_type 20 SAMPLE Ignored by uploader

measurement_type 20 CONTINUOUS | DISCRETE pmag_run.pmag_meas_type

core_status 20 WHOLE | ARCHIVE | WORKING pmag_run.pmag_core_status
4 X_response 7.4
pmag_calib.pmag_response_x

Y_response 7.4
pmag_calib.pmag_response_y

Z_response 7.4
pmag_calib.pmag_response_z

X_calibration 11.4E3 SQUID calibration constant (emu/flux_quanta) pmag_calib.pmag_calib_x

Y_calibration 11.4E3 SQUID calibration constant (emu/flux_quanta) pmag_calib.pmag_calib_y

Z_calibration 11.4E3 SQUID calibration constant (emu/flux_quanta) pmag_calib.pmag_calib_z
5 Demag_axis 4 For alternating frequency (AF) demagnetization yields any combination of the characters XYZ. Will be NONE if a non-AF treatment is applied. XYZ when present populates pmag_run.pmag_demag_x|y|z_flag. Presence of XYZ causes pmag_section_data.pmag_demag_type to be set to "AF."

Applied demagnetization level 7.2 milliTesla (mT). When demag axis = NONE this and the following field are omitted. Intervening tabs also omitted. pmag_section_data.pmag_demag_level

Unit
For demag treatments this is always mT (milliTesla). Long Core acquisition doesn't currently define anything else. Mapped to pmag_run.pmag_alternate_treatment when XYZ combination is present.
6 alternate_treatment 40 Comment field pmag_run.pmag_alternate_treatment. Presently not used by Long Core.
7 core_length 5.1 Empty if measurement type = DISCRETE (cm) pmag_run.pmag_core_length

requested_daq_interval 5.1 Empty if measurement type = DISCRETE (cm) pmag_run.pmag_req_daqs_interval

number_daqs_samples 3 # of measurements taken at a point and averaged pmag_run.pmag_num_daqs_sample
8 tray_corrected 3 YES | NO YES = 1, NO = 0; pmag_run.pmag_tray_corr_flag

tray_date_time 13 empty if tray corrected = NO. Intervening tab is preserved. pmag_run.pmag_tray_date_time
9 drift-corrected 3 YES | NO pmag_run.pmag_drift_corr_flag

bkgnd_1_X 11.4E3 when drift-corrected = NO, this and subsequent fields on the line are blank. Intervening tabs are preserved. pmag_run.pmag_drift_bkgd_1_x

bkgnd_2_X 11.4E3
pmag_run.pmag_drift_bkgd_2_x

bkgnd_1_Y 11.4E3
pmag_run.pmag_drift_bkgd_1_y

bkgnd_2_Y 11.4E3
pmag_run.pmag_drift_bkgd_2_y

bkgnd_1_Z 11.4E3
pmag_run.pmag_drift_bkgd_1_z

bkgnd_2_Z 11.4E3
pmag_run.pmag_drift_bkgd_2_z

bkgnd_1_time 10
pmag_run.pmag_drift_bkgd_1_time

bkgnd_2_time 10
pmag_run.pmag_drift_bkgd_2_time
10 section_id 7 0 pmag_section_data.section_id looked up based on L/S/H/C/T/S keys provided in sample data. Upload fails if no match.
11 number of data points 4
Ignored by uploader.
12 START OF DATA
"N" rows of data follow. Used by uploader to flag start of repeated body records.
13 <extra space> 1 SampleID is formatted according to the old ODP standard. These keys are used to look up the database section IDs in the core log.

Leg 3 For continuous runs, L/S/H/C/T/S are the same for each sample record. In discrete runs, these values are different, but each run goes in its own separate file (i.e., only one sample point per discrete run-file vs many points in a single continuous run-file). pmag_run.leg, pmag_section_data.leg, pmag_run_data.leg

sub leg 1
Ignored by uploader.

site 4


Hole 1


Core 4


Type 1


Section 2 Section number or CC pmag_section_data.section_id

top_interval 5.1
pmag_run_data.pmag_top_interval. For discretes uploader looks up PMAG sample table IDs based on this information. Plugged into pmag_section_data.pmag_sample_id and pmag_section_data.pmag_sam_location

bottom_interval 5.1
pmag_run_data.pmag_bottom_interval

corrected_inclination 6.2
pmag_section_data.pmag_inclination

corrected_declination 7.2
pmag_section_data.pmag_declination

corrected_intensity 11.4E3
pmag_section_data.pmag_intensity

corrected_X_intensity 11.4E3
pmag_run_data.pmag_corr_intensity_x

corrected_Y_intensity 11.4E3
pmag_run_data.pmag_corr_intensity_y

corrected_Z_intensity 11.4E3
pmag_run_data.pmag_corr_intensity_z

corrected_X_moment 11.4E3
pmag_run_data.pmag_corr_moment_x

corrected_Y_moment 11.4E3
pmag_run_data.pmag_corr_moment_y

corrected_Z_moment 11.4E3
pmag_run_data.pmag_corr_moment_z

uncorrected_X_moment_mean 11.4E3
pmag_run_data.pmag_uncorr_moment_x_mean

uncorrected_X_moment_sd 11.4E3
pmag_run_data.pmag_uncorr_moment_x_sd

uncorrected_Y_moment_mean 11.4E3
pmag_run_data.pmag_uncorr_moment_y_mean

uncorrected_Y_moment_sd 11.4E3
pmag_run_data.pmag_uncorr_moment_y_sd

uncorrected_Z_moment_mean 11.4E3
pmag_run_data.pmag_uncorr_moment_z_mean

uncorrected_Z_moment_sd 11.4E3
pmag_run_data.pmag_uncorr_moment_z_sd

sample_time 10 Zero-padded relative time from a high-frequency counter pmag_run_data.pmag_sample_time

core_diameter 5.2 Present when measurement type = CONTINUOUS. Otherwise blank. Intervening tabs are preserved. pmag_run_data.pmag_core_diam

sample_volume 5.2 Present when measurement type = DISCRETE. Otherwise blank. Intervening tabs are preserved the core_diameter is blank and sample_volume is present. Not uploaded. Already logged in sample.volume

data_type 20 LEADER | TRAILER | SAMPLE pmag_run_data.pmag_data_type
13+N END OF DATA
Marks the beginning of data points
Example Discrete File Output
0558 01/12/01 1634
CRYO
SAMPLE DISCRETE WORKING
6.0710 6.2080 9.9230 8.2100E-5 -8.3400E-5 4.3200E-5
NONE
1
YES 01/08/01 2112
YES 0.0000E+0 2.1510E-10 0.0000E+0 3.1692E-11 0.0000E+0 -3.5856E-11 0000000000 0000037374
0000000
0001
START OF DATA
194 1192 A 2 H 2 50.0 50.0 50.24 271.18 6.1530E-4 8.1327E-6 -3.9346E-4 4.7299E-4 4.8796E-11 -2.3608E-9 2.8379E-9 1.0919E-10 0.0000E+0 -2.3519E-9 0.0000E+0 2.8279E-9 0.0000E+0 0000010494 6.00 SAMPLE
END OF DATA
Example Continuous File Output with Demag Level Applied
0001 01/10/01 0408
CRYO
SAMPLE CONTINUOUS ARCHIVE
6.0710 6.2080 9.9230 8.2100E-5 -8.3400E-5 4.3200E-5
XYZ 5 mT
147.0 5.0 1
YES 01/08/01 2112
YES 0.0000E+0 1.4548E-9 0.0000E+0 4.5536E-10 0.0000E+0 -3.9744E-11 0000000000 0000138746
0000000
0032
START OF DATA
194 1192 A 1 H 1 -5.0 -5.0 12.25 206.31 4.7994E-3 -4.2042E-3 -2.0789E-3 1.0184E-3 -4.2348E-7 -2.1413E-7 1.6767E-7 -4.2343E-7 0.0000E+0 -2.1411E-7 0.0000E+0 1.6766E-7 0.0000E+0 0000005248 16.59 LEADER
194 1192 A 1 H 1 0.0 0.0 21.43 14.97 1.4044E-2 1.2630E-2 3.3762E-3 5.1304E-3 1.2722E-6 3.4775E-7 8.4466E-7 1.2723E-6 0.0000E+0 3.4778E-7 0.0000E+0 8.4466E-7 0.0000E+0 0000009473 16.59 SAMPLE
...
194 1192 A 1 H 1 145.0 145.0 -2.55 1.08 4.6061E-3 4.6007E-3 8.6665E-5 -2.0489E-4 4.6342E-7 8.9265E-9 -3.3732E-8 4.6477E-7 0.0000E+0 9.3491E-9 0.0000E+0 -3.3769E-8 0.0000E+0 0000128764 16.59 SAMPLE
194 1192 A 1 H 1 150.0 150.0 -3.62 300.91 7.9815E-4 4.0922E-4 -6.8340E-4 -5.0366E-5 4.1220E-8 -7.0390E-8 -8.2922E-9 4.2613E-8 0.0000E+0 -6.9954E-8 0.0000E+0 -8.3303E-9 0.0000E+0 0000132860 16.59 TRAILER
END OF DATA
CMnnnnnn.TRY Files
• File format implemented in software system Long Core (version 191) by source modules named Long Core Header Writer.vi and Long Core Data Writer.vi.
• Data upload is currently not supported for the content of these files.

Table AT2. Long Core data matrix for TRY files.

File
line
Field name
Field
format
Content (Long Core notes)
1 run_number 6 zero-padded 6-digit whole number

run_date_time 13 mm/dd/yy hhmi
2 system_id 20 CRYO | SPINNER
3 run_type 20 TRAY

measurement_type 20 CONTINUOUS

core_status 20 Field is blank. Preceding tab is preserved.
4 X_response 7.4 Calibration data recorded just as in the DAT format.

Y_response 7.4

Z_response 7.4

X_calibration 11.4E3 SQUID calibration constant (emu/flux_quanta)

Y_calibration 11.4E3 SQUID calibration constant (emu/flux_quanta)

Z_calibration 11.4E3 SQUID calibration constant (emu/flux_quanta)
5 core_length 5.1 Empty if measurement type = DISCRETE (cm)

requested_daq_interval 5.1 Empty if measurement type = DISCRETE (cm). Interval at which consecutive measurements are taken.

number_daqs_samples 3 # of measurements taken at a point and averaged.
6 Blank line 40 Comment field?
7 drift-corrected 3 YES | NO

bkgnd_1_X 11.4E3 When drift-corrected = NO, this and subsequent fields on the line are blank. Intervening tabs are preserved.

bkgnd_2_X 11.4E3

bkgnd_1_Y 11.4E3

bkgnd_2_Y 11.4E3

bkgnd_1_Z 11.4E3

bkgnd_2_Z 11.4E3

bkgnd_1_time 10

bkgnd_2_time 10
8 number of data points 4
9 START OF DATA
"N" rows of data follow. Data acquired at fixed down the length of the 'core boat' or tray.
10 run_date_time
mm/dd/yy hhmi

top_interval 5.1 cm

bottom_interval 5.1 cm

corrected_inclination 6.2

corrected_declination 7.2

corrected_intensity 11.4E3

corrected_X_intensity 11.4E3

corrected_Y_intensity 11.4E3

corrected_Z_intensity 11.4E3

corrected_X_moment 11.4E3

corrected_Y_moment 11.4E3

corrected_Z_moment 11.4E3

uncorrected_X_moment_mean 11.4E3

uncorrected_X_moment_sd 11.4E3

uncorrected_Y_moment_mean 11.4E3

uncorrected_Y_moment_sd 11.4E3

uncorrected_Z_moment_mean 11.4E3

uncorrected_Z_moment_sd 11.4E3

sample_time+SAMPLE 10 Zero-padded relative time from a high-frequency counter. No intervening tab between the number and the text SAMPLE.
10+N END OF DATA

Example Tray (TRY) File
1061 01/13/01 0500
CRYO
TRAY CONTINUOUS
6.0710 6.2080 9.9230 8.2100E-5 -8.3400E-5 4.3200E-5
160.3 5.0 1
YES 0.0000E+0 6.6501E-11 0.0000E+0 5.0874E-11 0.0000E+0 -1.0800E-10 0000000000 0000149118
0035
START OF DATA
01/13/01 0500 -5.0 -5.0 1.3488E-10 1.9012E-10 -2.0461E-10 1.3711E-10 0.0000E+0 1.9182E-10 0.0000E+0 -2.0822E-10 0.0000E+0 0000004993LEADER
01/13/01 0500 0.0 0.0 7.0775E-10 5.7403E-10 -1.0185E-10 7.1181E-10 0.0000E+0 5.7713E-10 0.0000E+0 -1.0843E-10 0.0000E+0 0000009088SAMPLE
...
01/13/01 0500 160.0 160.0 -2.8734E-10 7.6537E-11 4.3005E-11 -2.2495E-10 0.0000E+0 1.2427E-10 0.0000E+0 -5.8320E-11 0.0000E+0 0000139901SAMPLE
01/13/01 0500 165.0 165.0 -3.7945E-11 -4.9245E-12 -3.8270E-11 2.6272E-11 0.0000E+0 4.4202E-11 0.0000E+0 -1.4256E-10 0.0000E+0 0000143996TRAILER
END OF DATA

NEXT