|
Size: 2303
Comment:
|
Size: 3575
Comment:
|
| Deletions are marked like this. | Additions are marked like this. |
| Line 1: | Line 1: |
| {{attachment:emen2logo.png|EMEN2|width=250}} | {{attachment:emen2logo.png|EMEN2|width="250"}} |
| Line 3: | Line 3: |
| == EMEN2 == |
= EMEN2 = |
| Line 7: | Line 6: |
| EMEN2 is an object oriented database and electronic lab notebook. It is designed to store scientific data in a freeform way without limiting the ability to search/mine the results. Unlike a traditional database, where the contents of each record type (table) must be defined by a database administrator and strictly adhered to, each individual record in EMEN2 can have arbitrary additional parameters outside the record definition, and all such parameters remain fully searchable. | Structural and computational biologists frequently work with complex data sets assembled from diverse experimental sources, public resources, and analysis methods. Archiving and mining these data sets with their complicated interrelationships remains a persistent challenge, particularly with “open science” initiatives to make entire workflows, including all raw and intermediate data, available with publications. |
| Line 9: | Line 8: |
| Records in the database may be arbitrarily linked to each other, much like the web. Any record may link to an arbitrary number of other records of arbitrary type (the record's children). Many other records may link to each record (the record's parents). This permits, for example, a publication to be linked into a publications folder as well as being linked to a specific project; or a microscopy session may be a child of both the biological research project as well as the microscope the data was collected on. | To address these needs, we have developed EMEN2, an object-oriented scientific database and electronic notebook. EMEN2 uses a flexible schema based on plain text descriptions of experimental protocols. These protocols may be local and describe techniques and data within a single lab group. An EMEN2 installation can itself act as a resource, providing public access to selected protocols and data. While originally developed to serve the needs of the cryo-EM community, we believe EMEN2’s architecture provides an excellent foundation for many other scientific endeavors. |
| Line 11: | Line 10: |
| EMEN2 is developed using all open-source technologies. The core database is written in the Python programming language, with BerkeleyDB providing a robust embedded database back-end. The infrastructure is highly modular, permitting new ontologies to be fully implemented using only it’s “Web 2.0” interface. In addition, there is a remote API available for client applications. The included EMDash program is a standalone GUI tool for equipment integration, currently used to upload data transparently from our electron microscopes as it is being collected, as well as integrate with other lab equipment. The EMEN2 server itself can be extended in a similar way by writing custom Python modules, which can expose additional views to the Web interface, or new methods to the API. You can read about EMEN2 in the manuscript: [[http://www.ncbi.nlm.nih.gov/pubmed/23360752|Rees, I., Langley, E., Chiu, W., & Ludtke, S.J. (2013). EMEN2: an object oriented database and electronic lab notebook. Microsc Microanal 19, 1-10]] Please note, this is '''not''' the related [[EMAN2]] image processing system. == EMEN2 Mailing List == * [[http://groups.google.com/group/emen2|EMEN2 mailing list]] Please feel free to join the mailing list and ask questions, submit bug reports, or share results. |
|
| Line 13: | Line 24: |
| Line 16: | Line 26: |
| http://ncmi.bcm.edu/publicdata/db/home/ | * http://ncmi.bcm.edu/publicdata/ |
| Line 20: | Line 30: |
| == EMEN2 Installation and Configuration == * [[http://pypi.python.org/pypi/emen2|EMEN2 download]] |
|
| Line 21: | Line 33: |
| * [[EMEN2/Dependencies|Dependencies]] | |
| Line 22: | Line 35: |
| == Installation and Configuration == | * [[EMEN2/Install|Installation]] |
| Line 24: | Line 37: |
| * [[http://ncmi.bcm.edu/ncmi/software/software_details?selected_software=EMEN2|Download]] | * The [[EMEN2/emen2ctl|EMEN2 control script (emen2ctl)]] and [[EMEN2/Startup|starting the server at boot]] |
| Line 26: | Line 39: |
| * [[EMEN2/Dependencies|Dependencies]] | * [[EMEN2/Hardware|Planning hardware requirements]] |
| Line 28: | Line 41: |
| * [[EMEN2/Install|Install]] | == EMEN2 Guides == * [[EMEN2/Public_Data_Server|Basic EMEN2 overview]] |
| Line 30: | Line 44: |
| * [[EMEN2/config.yml|Configuration]] | * [[EMEN2/Backups|Backups and recovery]] |
| Line 32: | Line 46: |
| * [[EMEN2/User_Guide|User Guide]] | == EMEN2 API == * [[EMEN2/api|Public API documentation]] |
| Line 34: | Line 49: |
| * [[EMEN2/FAQ|FAQ]] | * [[EMEN2/rpc|Remote API access]] |
| Line 36: | Line 51: |
| * [[EMEN2/Backups|Maintenance and Backups]] | * [[EMEN2/Extensions|Writing EMEN2 extensions]] |
| Line 38: | Line 53: |
| == EMDash: EMEN2 Client documentation == * [[http://pypi.python.org/pypi/emdash|EMDash download]] |
|
| Line 39: | Line 56: |
| * [[EMEN2/emdash/Install|EMDash installation]] | |
| Line 40: | Line 58: |
| == EMEN2 Client Documentation == * [[EMEN2/emen2client.py|Command line upload/download client: emen2client.py]] * [[EMEN2/emdash|EMDash microscope client]] * [[EMEN2/EMAN2_Integration|EMAN2 Integration]] * [[EMEN2/Integration|Instrument Integration]] == Technical Discussions == * [[EMEN2/Architecture|EMEN2 Architecture]] * [[EMEN2/Ontologies|EMEN2 Ontologies]] * [[EMEN2/Export|Data harvesting and Export]] * [[EMEN2/API|Public API and Web Services]] |
* [[EMEN2/emdash/Tutorial|EMDash tutorial]] |
EMEN2
An extesible, object-oriented electronic lab notebook
Structural and computational biologists frequently work with complex data sets assembled from diverse experimental sources, public resources, and analysis methods. Archiving and mining these data sets with their complicated interrelationships remains a persistent challenge, particularly with “open science” initiatives to make entire workflows, including all raw and intermediate data, available with publications.
To address these needs, we have developed EMEN2, an object-oriented scientific database and electronic notebook. EMEN2 uses a flexible schema based on plain text descriptions of experimental protocols. These protocols may be local and describe techniques and data within a single lab group. An EMEN2 installation can itself act as a resource, providing public access to selected protocols and data. While originally developed to serve the needs of the cryo-EM community, we believe EMEN2’s architecture provides an excellent foundation for many other scientific endeavors.
EMEN2 is developed using all open-source technologies. The core database is written in the Python programming language, with BerkeleyDB providing a robust embedded database back-end. The infrastructure is highly modular, permitting new ontologies to be fully implemented using only it’s “Web 2.0” interface. In addition, there is a remote API available for client applications. The included EMDash program is a standalone GUI tool for equipment integration, currently used to upload data transparently from our electron microscopes as it is being collected, as well as integrate with other lab equipment. The EMEN2 server itself can be extended in a similar way by writing custom Python modules, which can expose additional views to the Web interface, or new methods to the API.
You can read about EMEN2 in the manuscript:
Please note, this is not the related EMAN2 image processing system.
EMEN2 Mailing List
Please feel free to join the mailing list and ask questions, submit bug reports, or share results.
EMEN2 Demo
There is a publicly accessible, read-only EMEN2 installation for accessing the NCMI's public datasets:
An overview document has been created to introduce new users to the EMEN2 web interface. It includes a number of screenshots.
EMEN2 Installation and Configuration
EMEN2 Guides
EMEN2 API