Differences between revisions 63 and 81 (spanning 18 versions)
Revision 63 as of 2013-04-18 06:08:56
Size: 3842
Editor: IanRees
Comment:
Revision 81 as of 2013-04-22 20:02:57
Size: 2711
Editor: IanRees
Comment:
Deletions are marked like this. Additions are marked like this.
Line 1: Line 1:
{{attachment:emen2logo.png|EMEN2|width=250}} {{attachment:emen2logo.png|EMEN2|width="250"}}
Line 4: Line 4:
Line 7: Line 6:
Please note, this is NOT the related [[EMAN2]] image processing system. Structural and computational biologists frequently work with complex data sets assembled from diverse experimental sources, public resources, and analysis methods. Archiving and mining these data sets with their complicated interrelationships remains a persistent challenge, particularly with “open science” initiatives to make entire workflows, including all raw and intermediate data, available with publications.
Line 9: Line 8:
Structural and computational biologists frequently work with complex data sets assembled from diverse experimental sources, public resources, and analysis methods. Archiving and mining these data sets with their complicated interrelationships remains a persistent challenge, particularly with “open science” initiatives to make entire workflows, including all raw and intermediate data, available with publications. To address these needs, we have developed EMEN2, an object-oriented scientific database and electronic notebook. EMEN2 uses a flexible schema based on plain text descriptions of experimental protocols. Investigators can use standard protocols shared throughout the community, or local, private protocols used in their lab. While originally developed to serve the needs of the cryo-EM community, we believe EMEN2’s architecture provides an excellent foundation for many other scientific endeavors.
Line 11: Line 10:
To address these needs, we have developed EMEN2, an object-oriented scientific database and electronic notebook. EMEN2 uses a flexible schema based on plain text descriptions of experimental protocols. These protocols may be local and describe techniques and data within a single lab group. An EMEN2 installation can itself act as a resource, providing public access to selected protocols and data. While originally developed to serve the needs of the cryo-EM community, we believe EMEN2’s architecture provides an excellent foundation for many other scientific endeavors. You can read about EMEN2 in the manuscript:
Line 13: Line 12:
EMEN2 is developed using all open-source technologies. The core database is written in the Python programming language, with BerkeleyDB providing a robust embedded database back-end. The infrastructure is highly modular, permitting new ontologies to be fully implemented using only it’s “Web 2.0” interface. In addition, there is a remote API available for client applications. The included EMDash program is a standalone GUI tool for equipment integration, currently used to upload data transparently from our electron microscopes as it is being collected, as well as integrate with other lab equipment. The EMEN2 server itself can be extended in a similar way by writing custom Python modules, which can expose additional views to the Web interface, or new methods to the API. [[http://www.ncbi.nlm.nih.gov/pubmed/23360752|Rees, I., Langley, E., Chiu, W., & Ludtke, S.J. (2013). EMEN2: an object oriented database and electronic lab notebook. Microsc Microanal 19, 1-10]]
Line 15: Line 14:
A full ontology for cryo-EM has been established for internal use and has been in active use at the NCMI for ~3 years. It is used to archive all data at the center, and currently provides services for over 750 users, with over 16 terabytes of data in 460,000 records.
As an example of its extensibility and ontology mapping capabilities, we have developed a module for harvesting the database and producing PDB compliant XML files which can be used to seed a structure deposition to EMDatabank.org.
Please note, this is '''not''' the related [[EMAN2]] image processing system.

== EMEN2 Mailing List ==
 * [[http://groups.google.com/group/emen2|EMEN2 mailing list]]

Please feel free to join the mailing list and ask questions, submit bug reports, or share results.
Line 19: Line 22:
Line 22: Line 24:
http://ncmi.bcm.edu/publicdata/  * http://ncmi.bcm.edu/publicdata/
Line 26: Line 28:
== EMEN2 Mailing List ==

 * http://groups.google.com/group/emen2

Please feel free to join the mailing list and ask questions, submit bug reports, or share results.
Line 33: Line 29:
Line 42: Line 37:
 * [[EMEN2/Hardware|Planning hardware requirements]]
Line 43: Line 40:
Line 46: Line 42:
 * [[EMEN2/Migration|Migrating from another database to EMEN2]]  * [[EMEN2/Backups|Backups and recovery]]
Line 49: Line 45:
 * [[EMEN2/api|Public API documentation]]
Line 50: Line 47:
 * [[EMEN2/api|Public API documentation]]

 * [[EMEN2/rpc|JSON-RPC and XML-RPC access]]
 * [[EMEN2/rpc|Remote API access]]
Line 57: Line 52:
Line 63: Line 57:

 * [[EMEN2/emdash|Using EMDash on microscopes]]

EMEN2

EMEN2

An extesible, object-oriented electronic lab notebook

Structural and computational biologists frequently work with complex data sets assembled from diverse experimental sources, public resources, and analysis methods. Archiving and mining these data sets with their complicated interrelationships remains a persistent challenge, particularly with “open science” initiatives to make entire workflows, including all raw and intermediate data, available with publications.

To address these needs, we have developed EMEN2, an object-oriented scientific database and electronic notebook. EMEN2 uses a flexible schema based on plain text descriptions of experimental protocols. Investigators can use standard protocols shared throughout the community, or local, private protocols used in their lab. While originally developed to serve the needs of the cryo-EM community, we believe EMEN2’s architecture provides an excellent foundation for many other scientific endeavors.

You can read about EMEN2 in the manuscript:

Rees, I., Langley, E., Chiu, W., & Ludtke, S.J. (2013). EMEN2: an object oriented database and electronic lab notebook. Microsc Microanal 19, 1-10

Please note, this is not the related EMAN2 image processing system.

EMEN2 Mailing List

Please feel free to join the mailing list and ask questions, submit bug reports, or share results.

EMEN2 Demo

There is a publicly accessible, read-only EMEN2 installation for accessing the NCMI's public datasets:

An overview document has been created to introduce new users to the EMEN2 web interface. It includes a number of screenshots.

EMEN2 Installation and Configuration

EMEN2 Guides

EMEN2 API

EMDash: EMEN2 Client documentation

EMEN2 (last edited 2013-04-22 20:02:57 by IanRees)