High-speed data management

The Spectrum series is designed for high-speed, synchronous sampling of analog inputs over EPI, resulting in large data sets. Given the rapid data collection speed of the Spectrum, a well-thought-out data management plan is crucial. Here are some steps for effective data management:

  1. Streamline data collection: Only keep necessary data. Adjust measurement or recording speeds to capture only needed data points without excess.

  2. Use event-based triggers:  Event triggers help filter and store only relevant data.

  3. Implement local data processing: Employ data logger real-time tools like Rainflow histograms, averaging, statistics, or the FFT function with the Spectrum CRBasic instruction CDM_FFTFilt() to reduce large data volumes.

  4. Use integrated Ethernet port: For high-speed applications, use the integrated data logger Ethernet port for fast and cost-effective data transfer. Integrated Ethernet may reduce concerns with cellular costs, Wi-Fi bandwidth, or USB throughput.

  5. Use FTP for Remote Transfers: Use FTP to send data from the data logger to a remote server. FTP is reliable, automated, and ensures easy access to the data on a server.

FTP streaming example:

Sending data over FTP is implemented by streaming data records from local final-storage tables with the optional FTP streaming parameters of the FTPClient() instruction. See the CRBasic Help for details. Also, see the Data Streaming application note. The example code below demonstrates configuring data streaming with the FTPClient() instruction:

'FTP streaming information
Const FTP-site = "ftp.box.com"
Const User = "User@domain.com"
Const PW = "UserPassWord"
Const Destination-Directory = "SPECTRUM Data/UserDirectory/"

 

'Public Variables

Dim TStamp As String *22
Public FTP_result
Public LastSentRecord As String *22

'Data Tables

DataTable (Static_AND_Temp, True, -1) ' Combined static strain and temperature table for FTPing

DataInterval (0,1,Sec,10)

Sample (8,StaticStrain_1(),IEEE4)

      ...

      ...

      ...

EndTable

'Measurement and processing instructions

    ...

    ...

    ...

SlowSequence
  Scan (1,hr, 0,0)

      TStamp = Mid (Public.Timestamp(5,1),1,16)

'Stream data from local Final storage table to FTP server

 FTP_result = FTPClient (FTP-site,User,PW,"Static_AND_Temp",     Destination-Directory & "1085_STATIC_AND_TEMP_",2,0,0,hr,8)

If FTP_result = -1 Then LastSentRecord = TStamp

  NextScan

EndProg