XeniaPackage < Main

Main

Main.XeniaPackager1.10 - 13 Dec 2025 - 22:59 - JeremyCothrantopic end

---+Xenia Package
[[http://nautilus.baruch.sc.edu/twiki_dmcc/pub/Main/XeniaPackage/XeniaPackage.ppt][Xenia Demo Powerpoint]]
[[http://nautilus.baruch.sc.edu/twiki_dmcc/bin/view/Main/XeniaSampleCase][Xenia Sample Case]]
Current script development at http://carocoops.org/xenia
*UPDATE: December 13, 2006: I've upgraded to [[http://nautilus.baruch.sc.edu/twiki_dmcc/bin/view/Main/XeniaPackageV2][version 2]] which is designed to support vector observation types, collections, quality control history, etc.  The earlier version will work ok for simple observation types, but I plan to focus all my new development efforts on version 2.* 
I've been trying to reduce and simplify what we're doing in terms of data collection and sharing for ocean observations(http://carocoops.org/portal_rs http://carocoops.org http://carocoops.org/carolinas) down to a single set of relational database tables and scripts.  The name I'm choosing for this effort is 'Xenia' which is a kind of coral found in many marine aquarium coral collections which waves through the water with many palms or hands.
The general issue which we run into is that data is collected to a data 'logger' in tabular format and it involves a lot of manual work to get data from these individual sensor datalogger formats into a more standardized forms which can be more easily aggregated and used.
The initial goal is to develop a good general relational table schema which we can push most all of our aggregated in situ observation data into and pull various products and web services from.  The secondary goal is the sharing of scripts which leverage this schema both to aggregate data and to provide output products and web services.
Again the Xenia problem/product I'm trying to address is the common datalogger/filesystem which collects 10-20 obs per hour at 1 to 100 platforms (*say less than 100,000 records total/hour*) and tying that back into our system of systems(CAROCOOPS, SECOORA, IOOS, GEOSS) with a common relational database driven schema infrastructure to develop products up from.
For high-volume data problems with *millions of records per hour(model outputs, hf radar, etc)*, this is not something which I think Xenia should address at this time except for possibly in terms of metadata tables describing these products.  High-volume data problems can continue being addressed as file/directory based, batch I/O processing bound problems with discussions more directed towards the organization of the data metadata files for *descriptive* (common visual legends for image overlay needs, common agreements on quality control application) and *archival* needs.
*Note: to see which pages have changed recently on this twiki click the 'Changes' link in the left hand sidebar.  At each page bottom there is a 'Total page history' link which shows each pages revisions.*
XeniaTableSchema
XeniaInputs
XeniaOutputs
XeniaSampleFlow
XeniaPackageImage
*Xenia Table Schema*
<img src="http://nautilus.baruch.sc.edu/twiki_dmcc/pub/Main/XeniaPackage/mulit_obs_beta_marked_2.bmp">
-- Main.JeremyCothran - 26 May 2025

to top

End of topic
Skip to action links | Back to top

Edit | Attach image or document | Printable version | Raw text | More topic actions
Revisions: | r1.10 | > | r1.9 | > | r1.8 | Total page history | Backlinks

You are here: Main > XeniaPackage

to top