Tuesday, 16 March 2010

Biopieces are a collection of bioinformatics tools ..



The Biopieces are a collection of bioinformatics tools that can be pieced together in a very easy and flexible manner to perform both simple and complex tasks. The Biopieces work on a data stream in such a way that the data stream can be passed through several different Biopieces, each performing one specific task: modifying or adding records to the data stream, creating plots, or uploading data to databases and web services. The Biopieces are executed in a command line environment where the data stream is initialized by specific Biopieces which read data from files, databases, or web services, and output records to the data stream that is passed to downstream Biopieces until the data stream is terminated at the end of the analysis as outlined below:
 
read_data | calculate_something | write_results 

The following example demonstrates how a Solexa deep sequencing experiment can be analyzed – including removal of adaptor sequence, determining the number of unique sequences, mapping to a specified genome, and uploading the data to the UCSC genome browser for further analysis: 

read_solexa i data.solexa |              #  Initialize data stream from a file. 
remove_adaptor -a TCGTATGCC -m 2 |        #  Remove adaptor sequence allowing for 2 mismatches. 
grab e ADAPTOR_POS > -1 |              #  Get all entries where an adaptor sequence was found. 
count_vals k SEQ |                       #  Determine the occurrences of all sequences.  
uniq_vals k SEQ |                        #  Get all entries with a unique sequence. 
merge_vals k SEQ_NAME,SEQ_COUNT |        #  Append the sequence count to the sequence name. 
vmatch_seq g hg18 |                      #  Map the sequences to the Human genome using Vmatch. 
upload_to_ucsc d hg18 t solexa_data x  #  Upload the mapping results to the UCSC Genome Browser. 
 
The advantage of the Biopieces is that a user can easily solve simple and complex tasks without having any programming experience. Moreover, since the data format used to pass data between Biopieces is text based, different developers can quickly create new Biopieces in their favorite programming language - and all the Biopieces will maintain compatibility. 

Monday, 15 March 2010

Good words on bad omics words: "A crisis in postgenomic nomenclature" from 2002

Good words on bad omics words: "A crisis in postgenomic nomenclature" from 2002

Posted using ShareThis

Thursday, 11 March 2010

Ray-0.0.3: a NEW MPI-based parallel genome assembler

The Ray Project Team gives you a 100% parallel MPI-based assembler called Ray. Ray is NOW available at http://sourceforge.net/projects/denovoassembler/files/. It supports Illumina paired-end reads. It is 100% parallel, and it is a single executable (no pesky perl scripts!). The source code is licensed with the GPL-v3.

Try it, and give us your comments, bugs, suggestions, and concerns on our mailing list.
http://lists.sourceforge.net/lists/l...ssembler-users

Ray-0.0.3: a NEW MPI-based parallel genome assembler
http://sourceforge.net/mailarchive/f...ssembler-users

***
The Ray Project Team
http://denovoassembler.SourceForge.net/

Compiling BFAST and DNAA in CentOS 5.4

Update finally got it to work.


#prereqs
GNU Autoconf version 2.59
GNU Automake version 1.9.6
GNU Libtool version 1.5.22
also requires bzlib.h found in bzlib-devel (debian name) in CentOS 5.4 it's bzip2-devel-1.0.3-4.el5_2.x86_64.rpm

#bfast prereq
download bfast source
tar zxvf bfast-0.6.3c.tar.gz
sh autogen.sh
./configure
make

#samtools source
download samtools source
tar jxvf samtools-0.1.7a.tar.bz2

#install this for tview use yum
/var/cache/yum/base/packages/ncurses-devel-5.5-24.20060715.x86_64.rpm
/var/cache/yum/base/packages/ncurses-devel-5.5-24.20060715.i386.rpm

cd samtools-0.1.7a
make

git clone  git://dnaa.git.sourceforge.net/gitroot/dnaa/dnaa

#symbolic link to bfast dir in root dir (.. relative to dnaa dir)
cd /home/username/bin/source/dnaa/dnaa
ln -s /home/username/bin/source/bfast-0.6.3c/ bfast
ln -s /home/username/bin/source/samtools/samtools-0.1.7a samtools
cd ..
ln -s /home/username/bin/source/bfast-0.6.3c/ bfast
ln -s /home/username/bin/source/samtools/samtools-0.1.7a samtools

cd /home/username/bin/source/dnaa/dnaa
sh autogen.sh
./configure
make


update: Used checkinstall to create rpm package so its easier for me to uninstall and recompile updates.
with checkinstall 1.6.2 I had to softlink a library

ln -s /usr/local/lib/installwatch.so /usr/local/lib64/installwatch.so


for bfast now the install method is 
tar zxvf bfast-*.tar.gz
cd bfast-*
sh autogen.sh
./configure
make
sudo checkinstall 
rpm -ivv bfast-0.6.4a-1.x86_64.rpm

Wednesday, 3 March 2010

Mongodb or Couchdb for storing NGS reads?

Been chasing missing reads in my 70 million short reads data from ABI SOLid. Other than the gremlins took them I have no idea why the code fails and works some times. NFS or Network issues perhaps? Not the sysadmin on the cluster so I can't do much except to audit my numbers each time.
Am thinking ahead of how to speed up or make the process more reliable and I found Brad's blog on his experience with document stores.
Going to follow up and do some testing with this when I have the time.

Tuesday, 2 March 2010

Image files from NGS sequencers

Good points raised in this article about how keeping your image files can be very expensive!

Do you keep them?
Post your comments!

Tips for de novo bacterial genome assembly

Found this handy article for  de novo bacterial genome assembly.

In Summary,
  1. Filter reads
  2. Use VelvetOptimiser Script
  3. Use Bowtie to map back reads to finished assembly to validate

Datanami, Woe be me