The Visible Dave Project |
| Monday, 04 April 2005 06:27 | ||||||||||||||||
|
a brain dump of sorts... Open Source + Open Data = Open Science The Visible Dave Project is a research project in modeling my physical body. My focus is on the general topics of MRI, DICOM, 3d modeling, 3d projections, data visualization, data fusion, and fun tricks for personal pleasure. If anyone has access to time on an MRI/fMRI machine in testing, please let me know...I would love to co-register with more datasets for temporal change analysis. Ultrasound time would also be cool. CT is great, but I don't enjoy lots of radiation. ;) Where is the data from? The data is from an MRI I had done in 2002. I didn't have it for diagnostics, it was just a sample MRI so that I could do visualizations with it. My head dataset is 256x256 which is pretty high resolution for MRI (low resolution when compared to things like CT). I have two datasets consisting of the sagital and transverse view. Slice thickness varies between the sagital(1.5mm) and transverse(1.7mm) views. The head MRI datasets show my nose cut off because of phase-wrap. This is because the MRI tech didn't set the field of view correctly on the machine for my head. In the sagital view, the nose data actually appears behind the back of my head. The transverse view does not contain my nose data at all! Someday, I will create a program to correct for the phase-wrap so that I can have a nice complete surface model. (bummer, this was a real bummer man) My aim in this project is to understand better the DICOM format, MRI physics, and voxel (3d pixel) processing. I've also come up with a bunch of silly uses for it like... it would be fun to create a 3d projection of my internal structures and allow for realtime surface exploration. Fun stuff!!! Plus, it is neat to see pretty pictures of the inside of my head. :-P If you are interested in my DICOM data for your own research, please let me know. I have them available to download... I just enjoy hearing from people interested in this sort of thing. I don't have problems with you using the data on presentations and papers. I enjoy collaboration. :) I'll continue updating this page as my project progresses. Here is some views of the MRI head1 dataset:
Visible Human I plan to build means of correlating my models against other models. I think the NIH - Visible Human project provides a wonderful dataset to correlate against. The National Library of Medicine's Visible Human Project Using VHD to build a comprehensive human model Marching Through the Visible Man Project Update! July 14th, 2006 I'm starting to think about ways to print my head out in physical form. At this point I have no idea on the best or cheapest way to do it. Anyway, if it is relatively cheap...I may just do it. How cool is that? A 3d model of your head on the desk. Talk about personalized art! 3d printers like ZCorp may be an option. Update: 07-29-2006 A cool side note about some cool crystal art
On another somewhat seemly un-related side note, all these thoughts on three dimensional data, visualization, and math has got me thinking about a kids toy. Zometool is a very neat toy, it allows you to teach a child geometry and math using sticks and balls. It feels a little like a mix between Legos and Tinkertoys, but zome is much more mathematical. With it you can create structures like hyper-cubes. Neato. Definitely going on my fun toy wishlist. I'm thinking about buying the book Zome Geometry, which gives a nice tour through a lot of great math structures and theorems. My nephew just got a kit and I was pretty impressed. You can even buy professional kits for huge structures. Zome web resources The Zome system is made by Zometool, Inc. Model of the month ZOME PUZZLES ZomeCad Anyways, back to the thought at hand.... thoughts on MRI modeling(DICOM).... More info on DICOM DICOM is a image format for medical imaging. Hospitals have ultrasounds, CTs, MRIs, and other equipment that store and transmit data in DICOM. So access and processing of these formats is very handy to have. DICOM is not just an image format. DICOM also does transport and routing (and I'm sure other things I don't yet know of...seems like a pretty big spec and I haven't had time for it all). One nice thing about DICOM is the ability to route information to machines on your network. Each machine and interface have their own titles. I don't yet know how I feel about this transport stuff... DICOM Resources: The DICOM Standard DCMTK - DICOM Toolkit MIR DICOM Central Test Node Software BET - Brain Extraction Tool FSL & FreeSurfer Courses FreeSurfer FMRIB Software Library Volume Rendering the Cortex Bio-medical Imaging in Java Project Update Jan-21-2007 I would like to get another head scan so that I can do comparative modeling of my internal structures. I would like to use these comparative models to build custom models which I can further study. So I can with my MRI, label and 3d model my brain surfaces. I could then overlay additional information for the surfaces. It would be very interesting to model EEG data on my brain region models. This would allow me to model structures over time in 3d and apply higher dimensional information to the question at hand. For instance, model the REM cycles and provide a count of periods of activity within the stages. Interesting. Knowing the surface of 3d things and how they interact in space can provide you with a wealth of information. In this model, I'm studying the real matter that gives rise to my thoughts and actions. The shape and interactions of my physical brain define the world as I perceive it. It amazes me, when I think about the effects of morphology on our physical world. In biology, surface interactions indicate enough information to build medicines that change 3d protein confirmation and thereby control gene expression. Controlling gene expression can offer the ability to modify feedback loops that happen over time. Project Update Feb-11-2007 FSL Evaluation and Example Data Suite FreeBSD and MRI FSL & FreeSurfer Courses - Lecture Slides and Practical Instructions Update: Feb-15-2007 It would be very nice to integrate my brain models with something like what is output from: Photorealistic models with MakeHuman Using photo-realistic models which are also physically-realistic could be very interesting. Then add to that the speech synths which will reproduce speech based on personalized vocal cord models...and 3d animations of the human body based on the real physical joints. Integration of multiple models provides for very scientifically accurate immersive environments for research and collaboration. Update: March-22-2007 I'm finding more of the programs and libraries I need to start getting results from my data. Thanks so much for everyone who has provided me with comments and questions. I also found two new web resources AMIDE: Amide's a Medical Imaging Data Examiner - competely free tool for viewing, analyzing, and registering volumetric medical imaging data sets. CT Sim - The Open Source Computed Tomography Simulator Update: May, 2007 OsiriX - DICOM Viewer NMR research (MRIUtil,vtkCNMRRLibrary,itkCNMRRLibrary) vtkCNMRRLibrary 1.0.3 Documentation - VTK based MRI tools dicom2 - convert medical images and DICOM files to various other formats, while optionally performing some rudimentary image processing tasks MITK(Medical Imaging ToolKit) - combines VTK and ITK Slicer NA-MIC Wiki BIRN - Biomedical Informatics Research Network The VolPack Volume Rendering Library ITK-SNAP Home Page The Papyrus toolkit 3 NeuroSlice brain model - MRI teaching model Interactive course about MRI physics dcm4che - Open Source Clinical Image and Object Management MacOS Notes On a mac, first of all, I would suggest installing OsiriX. It is quite good. Apple - Seminars Online - Getting Started with OsiriX Installing FSL on Apple Mac Dcmtk 3.5.4 on Mac OS X (fink packages) Making Your Own Visible Woman VoluMedic a add on for LightWave3D with DICOM support. Philips Free DICOM viewer DesAcc : DICOM Medical Imaging Software itk-SnAP Home Page itk SNAP Tutorial and User's Manual When building itksnap.trunk on the Mac I had trouble finding the ITK_FLTK_RESOURCE I would always get a ITK_FLTK_RESOURCE-NOTFOUND error from cmake. This is the resource file that FLTK provides for mac. It is included in your FLTK src tree under FL. (fltk.trunk/FL). The actual resource file is named mac.r inside this directory. Data Format Working Group â Neuroimaging Informatics Technology Initiative NIfTI-1 Data Format â Neuroimaging Informatics Technology Initiative NIfTI-1 Support â Neuroimaging Informatics Technology Initiative ImageJ Plugin - NIfTi Input/Output ImageJ Plugin - Import Dicom Sequence dcm2nii DICOM to NIfTI image conversion PyNIfTI - Python bindings to NIfTI MRIcron Index Page OSIRIS Presentation EN Santesoft - Sante DICOM Viewer FREE Professional DICOM viewer with free demo - Rubo Medical dicom viewer, pay. ReviseMRI.com: Study MRI physics Update: I've gotten the latest ITK-SNAP and it has produced me a great 3d mesh from the results of the automatic segmentation engine within ITK-SNAP. I've uploaded a few screen shots in my gallery. I've found getting the parameters right for segmentation is hard. There is a real art to the proper selection. What I'd like to be able to do is load a reference set of data with existing segmentation results and try to match my real data against it. I would like to get a huge set of labels for the brain and do this. It should be possible, right? PlanUNC - Welcome MRIcro Anatomical Templates Working with meshes A common format used today in fabrication shops is STL. MeshLab - is an open source, portable, and extensible system for the processing and editing of unstructured 3D triangular meshes. In the future, I'd like to load these meshes into a 3d silverlight application so people can select and explore my structures right on the website.  I like this picture because it is symmetric...and a bit freaky. ;) It is of me playing with the Mac PhotoBooth mirror effect. I plan to build a model of the above view. I could take my mesh structures and build a model which would represent this scene using the eyes, nose, and mouth to orient the models together. I should be able to do photo realistic lighting and shading...  (A plastic replica of a life sized human brain that shows multiple views. ) It would be great to produce custom educational diagrams/models based on my own data... I thought Brain 3D Chart - Raised Relief Chart was neat too. NIH's Clinical Image Processing Department - Software - etdips Data visualization in crystal - some very cool crystals of the human heart and CT scans shown. Tactile Visualisation: Feel your data! - has an awesome pdf with information on taking data and creating physical 3d models for exploring data tactilely. NITRC: The Neuroimaging Informatics Tools and Resources Clearinghouse - a large database of fMRI related software SourceForge.net: Grassroots DICOM - Grassroots DiCoM is a C++ library for DICOM medical files. It is automatically wrapped to python/C#/Java (using swig). It supports RAW,JPEG (lossy/lossless),J2K,JPEG-LS,RLE and deflated. It also comes with DICOM Part 3,6 & 7 of the standard as XML files. idoimaging.com - dicom and related software index. Dicom3tools Software - command line utilities for creating, modifying, dumping and validating files of DICOM attributes, and conversion of proprietary image formats to DICOM. DVTk (DICOM) - Wiwi - Downloads Update: Nov 13, 2008 OsiriX 1.0 for the iPhone!! Haha, I love to see stuff like this running mobile.  Update: Jan 07, 2009 Magnetic-Field-Induced DNA Strand Breaks in Brain Cells of the Rat - interesting research showing free radicals increase DNA single- and double-strand breaks due to prolonged exposure of magnetic field. I didn't know there was a Sigma assay to measure an index of DNA damage. Then also to treat for it using free radical scavengers! Update: Jan 29, 2009 hmm, need to make more time for this. :-) Update: Mar 28, 2009 Very nice models, though they cost money. Human Brain 3D Model 4.0 Neuron 3D Models - i'd really like to do neuron modeling here... Update: Jun 10, 2009 I've been sitting on this optical topography article I found from a science journal in 2005. I really like the idea of using optical properties for diagnostics. Maybe someday, I'll have enough time to work on a optical topography helmet, like the one I saw in that journal paper. However, I'd really like to setup a merged optical topography and EEG topography rig. Brain Topography - does ($$), cool to see a journal on it. Imaging brain function with optical topography - Medical Imaging Principle Of Optical Topography System Three-dimensional optical tomography of the premature infant brain Hitachi Medical Systems - Principles of Optical Topography SpringerLink - Journal Article - this seems like a good idea, Hemodynamic changes in the, motor cortex were measured during finger tapping before and after alcohol intake for eachALDH2 genotype. Hey I'm researching here... I wonder what the parts would cost... Oh I made a page on this a while ago..Optical Topography Update: June 24, 2009 A great source for MRI head data... MIDAS - Community Designed Database of MR Brain Images of Healthy Volunteers - MR database comprising images of the brain of 100 healthy subjects in which 20 patients were scanned per decade (18-29, 30-39, 40-49, 50-59, and 60+), with each group equally divided by sex, and with exclusion of any subject with a history of diabetes, hypertension, head trauma, psychiatric disease, or other symptoms or history likely to affect the brain. Images were acquired on a 3T unit under standardized protocols. Images include T1 and T2 acquired at 1x1x1 mm3, Magnetic Resonance Angiograpy (MRA) acquired at 0.5 x 0.5 x 0.8 mm3, and Diffusion Tensor Imaging (DTI) using 6 directions and a voxel size of 2x2x2 mm3. In addition to age and sex, handedness and race were also recorded. All subjects provided signed consent allowing images to be made publicly available on the web. -- We believe that this database may prove useful in assessing the effects of healthy aging but, perhaps even more importantly, could also provide the basis against which to assess a variety of diseases. MIDAS - Community Designed Database of MR Brain Images of Healthy Volunteers Update: Sept 24, 2009 Hey cool, other people have their personal MRI data up for people to look at too... Inside Bill Moorier's head - looks like a swf MRI explorer with two photo view navigation. A Tour of my Brain | Dustin Curtis - apparently Bill Moorier was inspired by Dustin Curtis's tour... Ya, now I was working on this other thing........ Update: Oct-02, 2009 Welcome to nipy’s documentation! — NIPY Documentation Update: Dec-11, 2009 Radiology Art: art made with x-rays using CT and MRI scanners - medical student, Satre Stuelke ct scanner as a camera. Update: Apr-17, 2010 I'm not sure what made me finally do it. I've been meaning to fix it for so long. But I'm happy I finally did. I used GDCM to correct the phase wrap artifacts in my sagittal scan. My nose is now attached to my face! I modified gdcmimg to support wrapping in the x direction. Empty/null data on the left and right sides of the scan made a simple wrap insufficient. I solved that issue by overlapping the right side of the "wrap region" with the left side of the scan. Then when compositing within the region of overlap, I select the highest contrast non-zero value from the two sources. Once gdcmimg was modified, I still needed a way to run that tool on all my DICOM files. I looked around a little bit for a tool...couldn't find what I wanted. So I created a new tool (using gdcm primatives) to search for dicom files within a directory and run gdcmimg with the new wrap options specified. The code isn't yet ready to share (not sure if it is even worth sharing), but a picture...can be done. I can now offer you the corrected dicom files if you'd like em. I will post a phase-wrap corrected animation some day too.  Now working to create a nice looking 3d projection with my nose where it belongs.. --dave Update: Apr-24, 2010 Computer Assisted Surgery blog - Going under the knife with technology. Final Project: Multimodal visualization for neurosurgical planning BioMed Central | Full text | Building generic anatomical models using virtual model cutting and iterative registration A Stereoscopic Volume Rendered Brain Atlas — Brains, Minds & Media Volume Rendering of the Photographic Visible Human Data Set Asclepios Research Project - INRIA Sophia Antipolis - MedINRIA Asclepios Research Project - INRIA Sophia Antipolis - SepINRIA is a free software dedicated to Multiple Sclerosis brain MRI analysis. IBASPM:Individual Brain Atlases using Statistical Parametric Mapping Software - matlab code. Volume Rendered Brain Atlas Update: May-3, 2010 A 3d projection of a skin model I created using ITK-SNAP (v2.1.0-dev mar23,2010) on my sagittal MRI head scan. This is the first model I've created with my nose attached to my face...(fixed phase-wrap artifacts). I really didn't take much care when creating this. So the results could be much better. But you get the idea. It is also looks like my model has been like been all stomped on squooshed (it looks more rectangular than it should, my dome looks taller and skinnier than it should.) I'm not sure why this happens within ITK-SNAP. More stuff to figure out...     I tried to save the vtk mesh and some of the other formats. But looking now, I can't find them. Also, I noticed that the UI was pretty unresponsive when I set the iterations up to 10 a step and turned on auto update mesh. Seems like when processing larger step values, it might need to yield more to handle windows messages. Need to build and look into that some more... I would like to start cutting and rendering multiple models here soon. Hoping to be able to use blender. --dave Update June 22, 2010 Neuropsychiatry Section - Pyvox (formerly known as BBLimage) is a set of software tools for medical image processing, particularly skull stripping and segmentation of MR brain images; Written in python and C. Under open source license.. Update Jan 21, 2012 whoa. Long time since last update. Human Connectome Project | Mapping the human brain connectivity Human Connectome Project | Gallery The LONI Probabilistic Brain Atlas (LPBA40) - Each MRI was manually delineated to identify a set of 56 structures in the brain, most of which are within the cortex. These delineations were then transformed into a common atlas space to produce a set of co-registered anatomical labels. The original MRI data were also transformed into the atlas space. LONI Brain Parser | Laboratory of Neuro Imaging, UCLA - NITRC: BrainParser: Tool/Resource Info Segmentation Validation Engine | - The Segmentation Validation Engine (SVE) provides an automated online framework for performing validation studies of skull-stripping methods. Registered users may download 40 T1 MRI volumes, skull-strip them with the algorithm of their choice, and upload their segmentation results to the SVE website. The server will then compare the 40 skull-stripped results against a set of manually generated brain masks. The server computes a series of measures for the uploaded data, including Jaccard and Dice measures. It also produces images for visualizing the spatial location of the segmentation errors relative to a common space. The results are archived on the server, and the measures are viewable by visitors to the site. Maybe this LONI Probabilistic Brain Atlas is the common atlas space to co-register my data with anatomical labels and other MRI data... Update: Mar 24, 2012 a lot of good content within the Brain Science Podcast. 79-"We actually are becoming an expression of the type of technology that we create. So, our brains not only create this technology, but they make it sure that whatever works—whatever tool that is capable of augmenting our reach— becomes assimilated as an extension of the internal brain model of our self." Update: may 16th, 2012 Edible Chocolate Brain from MRI Scan InVesalius - It generates 3D medical imaging reconstruction based on a sequence of 2D DICOM files acquired with CT or MRI equipments, providing several visualization tools. IGSTK - Image-Guided Surgery Toolkit Update: oct-21-2012 devide - Dataflow application builder for the rapid prototyping of medical visualization and image processing techniques - Google Project Hosting - DRE is in fact a Python distribution that includes cmake, swig, Python, numpy, matplotlib, wxPython, gdcm, VTK, ITK and DeVIDE itself. exposure-render - Open-source implementation of "Interactive direct volume rendering with physically-based lighting" - Google Project Hosting 
Update: Nov 11, 2012 DICOMEditMetaData - devide - Editing + Writing DICOM MetaData - Dataflow application builder for the rapid prototyping of medical visualization and image processing techniques - Google Project Hosting 
In the Apr-17, 2010 update, I mentioned correcting the phase wrap artifacts in my sagittal scan with a modification to gdcmimg. This attached my nose to my face, and also manually set the spacing, but for some reason each of the rewritten DICOM images were seen as separate series when using other DICOM tools. Recently, I figured out how to use DeVIDE to rewrite those DICOM results into a single series. (wiki link, cap of the multi-series issue as seen in the DICOMBrowser within DeVIDE, and dvn network graph provided above)biomedical optics - waves, acousto and light, tissues optics, interoperability, image processing Ogle Large-Scale Scientific Data Visualizer (2002 July: Development stopped) About MindSeer - University of Washington Structural Informatics Group Simian - Volume Rendering Volume-One Volume Viewer - ImageJ plugin FreeSurferWiki - Free Surfer Wiki Volume Rendering the Cortex - A hybrid approach to the skull stripping problem ... [Neuroimage. 2004] - PubMed - NCBI Chris Rorden's Neuropsychology Lab NITRC: Computational Morphometry Toolkit (CMTK): Tool/Resource Info Neuroimaging in Python - Pipelines and Interfaces — nipy pipeline and interfaces package Brain Continuous Semantic Space OpenCTM - Compression of 3D triangle meshes Update Feb 14, 2013 MRI Music Video by Sivu - Neatorama 3D Printing of Preclinical X-ray Computed Tomographic Data Sets | JoVE Video
|
||||||||||||||||
| Last Updated on Wednesday, 03 April 2013 09:32 | ||||||||||||||||
