VLab Data Transfer

Setup

1. Download and setup NaradaBrokering (Version 1.1.3) and HPsearch (Version 1.2.1)
2. Download VLAB Data Transfer Service and untar/gunzip on a machine in FSU and CGL. Refer here for additional configuration.
3. Once the system is up we have the following
   • A node running HPSearch kernel (e.g. gf5.ucs.indiana.edu, ShellWS on port 28080)
   • A node(s) running NaradaBroker (e.g. gf6.ucs.indiana.edu, NIOTCP on port 3045)
   • A machine in FSU running a copy of VLAB Data Transfer service (e.g. on port 5700)
   • A machine in CGL running a copy of VLAB Data Transfer Service (e.g. on port 5600)
   • Running copy of Context service (e.g. gf8.ucs.indiana.edu, port 4780)

Working of the system

1. The VLAB portal invokes the HPSearch Shell Web Service's submit operation with the following parameters
   • Path to the runner.js script accessible from the node where the HPSearch kernel is running
   • Parameters to the script. Refer the script (in Downloads section), for parameters
   A sample call looks like following

   path = "file:///home/hgadgil/services/vlabDataXfer/script/runner.js";
   
   srcService = "http://trex.ucs.indiana.edu:5600/axis/services/WSSConnector?wsdl";
   srcFile="file:///home/hgadgil/tmp/datafile.dat";
   
   destService = "http://pamd.csit.fsu.edu:5700/axis/services/WSSConnector?wsdl";
   destFile = "file:///fsu/csit.fsu.edu/export/home/hgadgil/datafile.dat";
   
   arguments =  srcService +" " + srcFile + " " + destService + " " + destFile;
   			
   String uuid = submit(path, arguments);
   		

2. The ShellWS Web Service returns with a UUID for the flow
3. The HPSearch context handler then sets the context value (Refer Script, E.g. context://vlab/uuid:12345678-1234-1234-123456789012) with the value EXECUTING
4. The HPSearch flow manager then initializes both services and sets up the correct topics for flow transfer
5. Data is streamed from CGL to FSU (in the case shown in diagram), through the brokering network on the topic set by HPSearch
6. Finally when the flow is done, HPSearch context handler sets the context value to DONE to signify flow completion.
7. The Vlab portal may continue to poll the context service to check if the flow finished

Downloads

• Services
• Runner Script