Changes between Version 5 and Version 6 of HpcInfo


Ignore:
Timestamp:
Jan 25, 2012, 7:38:55 PM (12 years ago)
Author:
dzollars
Comment:

--

Legend:

Unmodified
Added
Removed
Modified
  • HpcInfo

    v5 v6  
    1414The purpose of this system is to interface with the user to specify an analysis type, such as the Genetic Algorithm (GA) or Two Dimensional Spectrum Analysis (2DSA), as well as the needed parameters for the analysis to the HPC system.  After the user specifies the needed data, the data is packaged into a common data directory, uslims3.uthscsa.edu:/srv/www/htdocs/uslims3/uslims3_data. For this analysis request LIMS creates a new GUID, associates it with the analysis data, and creates a new record in the HPCAnalysisRequest database table. This record is the parent record for everything relating to this HPC analysis, and this GUID serves as the common identifier of this analysis. For instance, this GUID is the name of the subdirectory in the common data directory where all the files relating to this particular analysis are stored when the job is submitted to the HPC system. Another example: LIMS prepends the string "US3-" to this guid and it becomes the gfacID, used by the GFAC system to identify the job, and used in the listen script and grid control program to identify the job. The database name and gfacID is how the grid control program associates the HPC job with the analysis request record in the LIMS database.
    1515
    16 === Contents of the data directory ===
     16== Contents of the data directory ==
    1717
    1818[wiki:Us3HpcDb US3 HPC Database Tables]
    1919
    20 === The LIMS job submit process ===
     20== The LIMS job submit process ==
     21
     22In LIMS job submission is a two-step process. In the first step everything related to the data itself is collected and placed into a tar file. File names:
     23
     24|| Contents of file              || File name                                  ||
     25|| Scan data itself              || runID.dataType.cell.channel.wavelength.auc ||
     26|| Edit profile                  || runID.editedDataID.dataType.cell.channel.wavelength.xml ||
     27|| Analysis parameters           || hpcrequest-server-database-requestID.xml   ||
     28|| Noise files                   || random.ti_noise or random.ri_noise         ||
     29|| Tar file with above content   || hpcinput-server-database-requestID.tar     ||
    2130
    2231== Supercomputer Queue ==