2021.05

• Replaced vis.js for cytoscape.js to display the processing networks.
• The commands available to users, originally only filtered by input type, are now also limited by the preparation type. The options are taken from the recommended workflows.
• Added a new spades assembly pipeline for "Genome Isolate".
• Fixed the following issues: #3070, #3089, #2968, #3102, and #3079.

2021.03

• Fixed issue that left behind non gz per sample FASTQ files.
• Recommended Workflows are now stored in the database.
• Added a new button only for owners and admins within the Study page to display a list of all the Analyses generated with that study; helpful to clean up Studies and for general information.
• The Qiita CI now runs as GitHub Actions; moving away from Travis CI.
• Prep information file object now stores its creation and modification timestamps.
• Improved creation time for all information files via the to_dataframe() method.
• Split the "other" category of the storage stats plot (https://qiita.ucsd.edu/stats/) into "other" and "biom" so biom can be its own category.
• Added a processing_jobs property to qiita_db.software.Command to easily retrieve all jobs in the system that have ran the given command.
• Fixed the following issues: #3068, #3072, #3076, and #3070.

2021.01

• Moved the qiita repo from biocore to qiita-spots.
• Created the Qiita portal for the Cancer Microbiome.
• The EBI-ENA code now verifies that the sample information file has a description column; this wasn't previously required because it was automatically prefilled by the QIIME 1 mapping file.
• Now it is possible to download the per preparation sample information file and the sample-preparation summary.
• Added a faster metagenomic/metatranscriptomic adaptor and host removal step based on fastp and minimap2. The previous version, using atropos and bowtie2 for QC host filtering, is now deprecated.
• Added qiime2.2020.11 to the system; which updated these plugins: qp-qiime2, qtp-biom, qtp-diversity, qtp-visualization.
• Added WoL tree for phylogenetic analyses (/projects/wol/release/databases/qiime2/phylogeny.qza) with per-genome WoL artifacts.
• Fixed the following issues: #3060, #3049, and #2751.

2020.11

• Deprecated the automatic creation of the per template QIIME1 mapping file. If you want to merge a preparation and a BIOM table you must first create a meta-analysis.
• Added a new autoloaded boolean flag to the Study object so we can control if a study was autoloaded via an automatic EBI-ENA or SRA loading job.
• We stopped adding the CRC32 information from mod_zip, which should remove the warnings about CRC incorrect checksums.
• Removed the show/hide button from an analysis while the analysis was being built to avoid possible confusion.
• A new per-sample, fast, bowtie2 and Woltka plugin for WGS and Metatrascriptomics processing has been added, deprecating the Shogun plugin and moving the rest of the commands to a new qp-meta plugin.
• Added the possibility for plugins to submit and control their own jobs vs. Qiita automatically submitting for them. For specifics of this new functionality, (visit #3040)
• We increased the number of workers in qiita.ucsd.edu for the web interface (from eight to twenty), redbiom (from eight to ten), and the plugin interactions (from eight to twenty). This should speed up responses and improve general performance.
• For the qp-qiime2 plugin, we removed some unsupported alpha rarefaction metrics from the options, following QIIME2 guidelines.
• For the qp-qiime2 plugin, if the user selects a tree but it doesn't exist, it will not try to parse and skip it.

2020.09

Version 2020.09

• Added a new endpoint to inject artifacts to existing preparations or jobs: /qiita_db/artifact/
• Outdated commands with the exact same name than newer commands will be marked as not outdated. This is helpful for cases where the commands haven't changed between version
• Added the add_ebi_accessions to the to_dataframe() method of the information files so it can be used to redbiom. This will allow searching via sample or experiment accessions
• Added the release_validator_job method to ProcessingJob method to easily retrieve the release_validator job of a processing_job
• Re-added STUDY_TYPE to the EBI-ENA submission as they are required but deprecated so just adding as Other
• Added qiime2.2020.08 to the system; which updated these plugins: qp-qiime2, qtp-biom, qtp-diversity, qtp-visualization
• Shogun processing using Woltka will now produce 2 extra artifacts: a per genome and per gene artifacts

2020.07

The last "official" release was done back on October 31st, 2017; however, code and deployments to the main Qiita site have been happening around every 2 months since then. For all the changes since the last "official" release visit the CHANGELOG.md.

Version 2020.07

• Added per preparation LIBRARY_STRATEGY and removed the study wide STUDY_TYPE values for EBI-ENA submissions to comply with newer metadata standards
• Changed Ion Torrent to Ion_Torrent as described by EBI-ENA
• Added a VALIDATOR job_type to be able to specify job validator resources
• Added a job.shape method that returns the number of columns, samples and input size of each job based its input artifacts
• Added the possibility of requesting memory resources for a job based on the input size, number of samples and/or columns
• Warnings from commands will only use the message part of the warning/errors (#2898)
• Fixed error when deleting multiple artifacts with summaries and support_files
• Button now will be disabled when submitting a workflow via GUI to avoid double clicking from users
• Jobs will now display their "external job id" to users, in practice their barnacle job id
• Fixed bug that prevented delete of full analyses when the processing tree had multiple paths
• Added initial script for nightly auto-processing of workflows
• Removed legacy future dependencies from Python2.7
• Users can see the available system plugins, their commands and resource allocations: https://qiita.ucsd.edu/software/
• Added qiime2.2020.06 to the system; which updated these plugins: qp-qiime2, qtp-biom, qtp-diversity, qtp-visualization
• Shogun v1.0.8 for Metagenomic and Metatrascriptomics processing; this new version includes bowtie2 v2.4.1 as aligner and Web of Life and rep200

October 31st, 2017

In this release:

• Taxonomy information is kept in the BIOM tables after filtering samples.
• User-friendly command and parameter names.
• When uploading sample/prep information, the system prefixes with the study id only those samples that have not been prefixed before.
• A warning for the "Downloads" dropdown has been added to the user is aware that he is going to download a big file.
• When uploading per-sample FASTQ's now the system provides more information about the missing (or extra) files.
• The validation process of per-sample FASTQ's now properly checks for the run prefix, rather than exact filename.
• A button to download the mapping file has been added in the analysis pipeline.
• In the study list, now the artifacts are grouped by processing command and parameters.
• RedBiom results now shows the number of unique samples, rather than the number of samples in all artifacts
• When processing an artifact, it now gets auto-selected when entering in the processing page.
• A bug preventing the Sample Summary page from loading in some cases has been fixed.
• The ID's of the jobs validating the output of a previous job have been added to the parent job status message.
• Fixed a bug that embedded the login page in a div if a query to the system failed.
• Sample Summary and Sample Information is now under the same menu item
• A bug in the bulk study deletion that prevented to delete studies without Sample Information has been fixed
• A log of files uploaded to the sample/prep information pages is shown.
• Update to use QIIME2 2017.9
• Update to use deblur 1.0.3
• Artifact parameters and commands have been normalized to latest command available.

October 13th, 2017 (Bugfix from September 27th)

In this release:

• Redbiom integration
• Removal of the moi/ipython cluster dependency
• UTF8 characters are now correctly checked at upload time (rather than just printable)
• Processing job list is shown as a modal rather than a list on the right
• Download of directories is now available
• User-defined artifact name is now honored.
• New artifacts are named after the command output name
• Admins now have access to analysis to support users
• Bulk study deletion
• Input textbox for renaming artifacts automatically focused
• Add BIOMs directly to the analysis from the study processing pipeline.
• EBI submission bug and error catching fixed.

August 23rd, 2017

Functionality added:

• Non-UTF8 errors in the metadata: when found, the system shows a message changing the offending character by 🐾 and with the (row, column) numbers
• The study list now shows the number of samples present in the prep information of the BIOM table
• The study list now shows the owner of the study
• Artifact creation timestamp is displayed in the artifact page
• Prep summary page now has the values collapsed similarly to the sample summary page
• Studies are not searchable by alias

Issues fixed:

• The warning messages from the metadata template are now correctly reseted when the metadata is updated
• The race condition when completing jobs (e.g. deblur jobs) has been removed. All jobs should be finishing smoothly

Qiita 0.2.0: alpha release

The Qiita development team is pleased to announce the second alpha release of Qiita.

In this release we closed more than 80 issues, some of these are:

• Portals: Within the same hardware you can host as many portals as you want simply by changing the configuration file that is being used. This will allow admins to generate specific presentations of data without having to duplicate the information. For example, http://qiita.microbio.me has all available studies and http://sloan_microbe.microbio.me is a front end only for the Sloan related studies. User accounts will work in any portal within the same system i.e. if you already have an account in the main Qiita deploy you don’t need to create a new account to access the Sloan portal.
• Download analysis biom and mapping file: Now you can download the biom and mapping file of any analysis generated within your account.
• Notification system: Qiita has a new system allowing users to receive messages about the system, possible updates, and improvements.
• Now you can upload and process SFF.gz files. This should represent an improvement on the size of files you need to upload.
• Ability to process sequence data that has already been demultiplexed, note that your sequences need not to include any technical reads (barcodes or primers).
• New documentation hosted as part of every system, see an example here, these documents include information about the file formats, pipelines and use cases that Qiita tries to account for. Make sure to add an issue if there’s information that you think may be missing here.

Miscellaneous

• Transactions: To avoid database collisions all modifications to the DB are now run within transactions, which allow complete rollbacks on any failure, including file creation.

As always we encourage you to participate in the development of Qiita by:

• Reporting a bug or feature request in our issue tracker.
• Submitting a new feature (if you are curious please review our development guidelines).
• Adding your study to the system, which should not only facilitate its analysis but will allow you to combine it with other public studies or even share it with other users.