Short command lines for manipulation FASTQ and FASTA sequence files

I thought it was time for me to compile all the short command that I use on a more or less regular basis to manipulate sequence files.

Convert a multi-line fasta to a singleline fasta

 

To convert a fastq file to fasta in a single line using sed

 

Dirty way to count the number of sequences in a fastq

It’s dirty because sometimes the quality information line may also start with “@” so the number of sequences could be overestimated.

A more precise way is to count the lines and divide by four:

One liner to remove the description information from a fasta file and just keep the identifier

 

Get all the identifier names from a fasta file

 

Extract sequences by their ID from a fasta file
For example, you want to get the sequences with id1 and id2 as identifiers

If you have a long list of identifiers in a file called ids.txt, then the following should do the trick:

 

Convert from a two column text tab-delimited file (ID and sequence) to a fasta file

 

Get the length of a fasta sequence (the sequence must in singleline)

 

I’ll update this when I find some more useful single line commands for manipulation fastq and fasta files.

Please post comments if you have some suggestions.

 

  • Ma Pengze

    haha I like awk~

  • Richard Orton

    Your cat sample1.fq | echo $((wc -l/4)) doesn’t seem to work for me for counting the number of reads in a FASTQ files – on BioLinux 8 – default z shell – I get an error:

    wc: standard input: Input/output error.

    This seems to work:

    echo $((wc -l < ReadFileName.fastq/4))

  • bljog

    If using Bourne shell (sh), it works. Also if you want to do it for .gz compressed fastq files:
    cat sample1.fq | echo $((wc -l/4)

  • bljog

    You could also switch to bash:
    exec bash
    And to switch back to zsh:
    exec zsh