Release Notes

You can find more detailed information at GitHub Issuesarrow-up-right.

2.0.0-RC1 (June 2020)

Catalog

Analysis

Variant Storage

1.4.2 (June 2019)

Catalog

1.4.2. contains a small series of internal changes requiring running a small migration. To do so, please head to the main OpenCGA source folder and run the following:

  • mongo_port: Typically 27017

  • database_name: Typically opencga_catalog

Variant Storage

  • [CHANGE] Rename filter "transcriptionFlag" to "transcriptFlag" (#1256arrow-up-right)

  • [BUGFIX] HashMap$Node cannot be cast to java.util.HashMap$TreeNode (#1323arrow-up-right)

  • [BUGFIX] Wrong usage of SampleIndex on invalid queries (#1274arrow-up-right)

  • [BUGFIX] Fix RowKey generation for non symbolic structural variants #1259

  • [FEATURE] Add chromDensity query filtering by sample genotype (#1249arrow-up-right)

  • [FEATURE] Accept nested fields in chromDensity by sample genotype (#1263arrow-up-right)

  • [FEATURE] Use SamplingSize field at SampleIndex query executor (#1339arrow-up-right)

  • [FEATURE] Add new variant filters: "cohortStatsAlt", "cohortStatsRef" (#1239arrow-up-right)

  • [FEATURE] Query by compound heterozygous (#1247arrow-up-right)

  • [FEATURE] Export variants given a file of variant Ids (#1254arrow-up-right)

  • [FEATURE] Accept keyword "LoF" in consequence type filter (#1262arrow-up-right)

  • [FEATURE] Implement a MR to extract number of variants per file #1287

  • [PERFORMANCE] Remove unneeded FileMetadata reads from HBaseToStudyEntryConverter (#1350arrow-up-right)

  • [PERFORMANCE] Improve SampleIndex read performance (#1319arrow-up-right)

  • [PERFORMANCE] Add annotation counters to SampleIndex (#1258arrow-up-right)

  • [PERFORMANCE] Reduce size of SampleIndex table (#1252arrow-up-right)

  • [PERFORMANCE] Include parents genotype in the SampleIndex (#1244arrow-up-right)

  • [PERFORMANCE] Skip join SampleIndex with Variants table when possible #1242

  • [IMPROVEMENT] Improve approximate count of CompoundHeterozygous in StorageHadoop #1299

  • [IMPROVEMENT] Improve DeNovo variants definition (#1340arrow-up-right)

  • [IMPROVEMENT] Improve Genotype filter to include by default phased genotypes (#1273arrow-up-right)

  • [IMPROVEMENT] Make /sampleData support somatic studies (#1329arrow-up-right)

  • [IMPROVEMENT] Add VarinatStats to SampleData result (#1286arrow-up-right)

  • [IMPROVEMENT] Native implementation of sampleData endpoint in storage-hadoop (#1285arrow-up-right)

  • [IMPROVEMENT] Extend panel filter to include regions and single variants #1272

  • [IMPROVEMENT] Extract variant query executor from VariantStorageEngine #1240

  • [COMMAND LINE] Add missing SampleIndex command line operations (#1282arrow-up-right)

1.4.0-rc1 (August 2018)

Catalog

  • [IMPROVEMENT] Recognise bigwig files automatically. (#283arrow-up-right)

  • [IMPROVEMENT] Major improvements in annotationSets (#635arrow-up-right, #772arrow-up-right, #849arrow-up-right):

  • [FEATURE] Implement new "Permission rules" feature (#745arrow-up-right)

  • [FEATURE] Add new /admin web services to be able to perform administrative operations through REST (#759arrow-up-right)

  • [IMPROVEMENT] Improve /user web services. Remove duplicated configs web services (#661arrow-up-right)

  • [FEATURE] Implement delete operations for most of the entries (#792arrow-up-right)

  • [IMPROVEMENT] Store creationDate field as an actual date object to improve queries (#752arrow-up-right)

  • [CHANGE] Important id changes (#819arrow-up-right):

    • Data model ids have been redefined to contain any user-defined id for every entry. Migrations produced in every entity are described in the ticket.

    • Old numeric ids are now lost and only used for internal purposes. Users cannot query by those fields anymore.

    • Update REST web services to support id changes (#834arrow-up-right)

  • [IMPROVEMENT] Stop creating empty directories when linking Files (#865arrow-up-right)

  • [FEATURE] Add new {entry}Action field to some update web services to support adding, setting or removing single entries to arrays of them. (Example: samplesAction to add, set or remove samples from an individual, file or cohort) (#850arrow-up-right)

  • [IMPROVEMENT] Deprecate VariableSet web services and move them to Study web services. Improve and clean old Study web services (#846arrow-up-right)

  • [IMPROVEMENT] General data model improvements described in #823arrow-up-right:

    • Add new inmutable uuid field to all entries.

  • [FEATURE] Create catalog solr sync mechanism and enable facet queries #875arrow-up-right

Variant Storage

1.3.11 (August 2019)

Catalog

1.3.10 (February 2019)

Catalog

  • [FIX] Remove base64 conversion of the secret key.

  • [FIX] Update pom dependencies to avoid conflicts.

1.3.9 (January 2019)

Catalog

1.3.8 (August 2018)

Catalog

  • [FIX] Fix permission issue affecting users and groups with the "_" symbol (#881arrow-up-right)

1.3.7 (July 2018)

Catalog

1.3.6 (May 2018)

Catalog

1.3.5 (May 2018)

Catalog

  • [FIX] Fix issue when assigning permissions given the id(s) of different entities (#836arrow-up-right)

1.3.4 (April 2018)

Catalog

1.3.3 (March 2018)

Catalog

  • [ENHANCEMENT] Remove old deprecated fields from Family data model (#810arrow-up-right)

  • [ENHANCEMENT] Allow looking for Individuals and Families by a new sample field (#811arrow-up-right)

  • [FIX] Fix command line to support non-expiring tokens

  • [FIX] Support SKIP_COUNT parameter

  • [CHANGE] Remove family completeness check

1.3.2 (February 2018)

Catalog

1.3.1 (February 2018)

Catalog

1.3.0 (January 2018)

General

Catalog

Variant Storage

1.2.0 (September 2017)

Catalog

  • [FIX] Fix job search by input and output files. (#533arrow-up-right)

  • [ENHANCEMENT] Hide deprecated webservices. (#599arrow-up-right)

  • [ENHANCEMENT] Set ontologyTerms array during Sample/Individual /create and /update webservices. (#613arrow-up-right)

  • [FEATURE] Add the concept of release in OpenCGA. (#616arrow-up-right)

  • [FIX] Fix behaviour where individual ids are not recognized when creating new family. (#617arrow-up-right)

  • [FEATURE] Implement JWT based session management (#618arrow-up-right)

  • [ENHANCEMENT] Change List<Long> for List<Object> in corresponding data models (#621arrow-up-right)

  • [ENHANCEMENT] Make ACL permissions part of the query (#628arrow-up-right)

  • [FIX] Fix count parameter not working in search webservices and command line (#629arrow-up-right)

  • [CHANGE] Change annotationsets REST webservices. (#631arrow-up-right)

  • [FEATURE] Support multigroups (#633arrow-up-right)

  • [ENHANCEMENT] Return HTTP 403 error code when user tries to access not granted data (#636arrow-up-right)

  • [FEATURE] Add a new members group for every study (#642arrow-up-right)

  • [FEATURE] Automatically sync OpenCGA groups with external LDAP groups during login (#647arrow-up-right)

  • [FEATURE] Add new projects/search webservice (#651arrow-up-right)

  • [FEATURE] Add new confidential parameter to VariableSet data model. It allows defining confidential variable sets and corresponding annotation sets, so a new special permission will be needed to access them. (#653arrow-up-right)

  • [FEATURE] Propagate permissions from samples to individuals. (#657arrow-up-right)

  • [ENHANCEMENT] Return HTTP 401 error code when user is not successfully logged in or the token is invalid. (#658arrow-up-right)

Variant Storage

Relevant changes

1.1.0 (June 2017)

Catalog

  • [ENHANCEMENT] Support integers and floats type for variables. (#545arrow-up-right)

  • [BUG] Fix link race condition. (#551arrow-up-right)

  • [FEATURE] Add new parameter propagate to Individual web service when setting permissions to propagate permissions to the related samples. (#558arrow-up-right)

  • [FEATURE] Add support to give permissions using queries in sample, individual and file web services. (#560arrow-up-right)

  • [CHANGE] Change Acl REST web services. (#561arrow-up-right)

  • [FIX] Not return fields that are of no interest (using include/exclude). (#569arrow-up-right)

  • [FEATURE] Add new admin command line to synchronise and add users from LDAP groups. (#573arrow-up-right)

  • [FEATURE] Added new Family data model. (#582arrow-up-right)

  • [FEATURE] Add list<Sample> to individual/create web service. (#583arrow-up-right)

  • [FEATURE] Add new /meta/status, /meta/ping and /meta/about web services. (#572arrow-up-right)

  • [ENHANCEMENT] Support creating an Individual when calling to the Sample create web service. (#586arrow-up-right)

  • [DEPRECATE] Deprecate species field of Individual data model. (#588arrow-up-right)

  • [ENHANCEMENT] Deprecate usage of variableSetId. Add field variableSet to corresponding web services that accepts an id or a name. (#589arrow-up-right)

  • [ENHANCEMENT] Support passing an array of annotationSets when creating an Annotable entry (Sample, Cohort, Individual and Family). (#590arrow-up-right)

  • [ENHANCEMENT] Add new type field to Sample model. (#591arrow-up-right)

  • [FEATURE] Add father and mother information in attributes field of Individual. (#592arrow-up-right)

  • [ENHANCEMENT] Add support to change public/private User registration (#594arrow-up-right)

  • [DEPRECATE] Deprecate all xx/create and xx/update GET webservices. (#598arrow-up-right)

Variant Storage

Relevant changes - migration

1.0.2

General

Catalog

1.0.0 (February 2017)

Catalog

  • [FIX] Authenticated users can now see public data (#501arrow-up-right)

  • Permissions assigned to individuals are directly propagated to samples (#509arrow-up-right)

  • [CHANGED] CREATE and UPDATE permissions have been merged into WRITE (#506arrow-up-right)

  • [CHANGED] Permissions given to folders are now propagated in the database (#505arrow-up-right), this increase significantly the performance of the ACL resolution

  • [CHANGED] Changes in session data model (#479arrow-up-right)

Storage

  • Complete the implementation of exclude and include of fields for Variant queries (#515arrow-up-right)

Clients

Server

  • [REST] Add new files/create using POST to create new folders and files with some content (#514arrow-up-right)

  • [REST] Rename parameters from acl/update (2617993arrow-up-right)

  • [REST] Hide from Swagger all create and update ACL web services using GET (cbea817arrow-up-right), these should always use POST, this affects to studies, samples, files, ... (these will be removed in version 1.1)

  • [REST] Complete the implementation of exclude and include of fields for Variant queries

  • [REST] Remove from users the GET methods to create and update filters (5125a22arrow-up-right)

  • [REST] Add a warning to Swagger to all create and update methods using GET (ee6d66arrow-up-right). It is encourage that all create and update actions use always POST

  • [GRPC] Complete the implementation of exclude and include of fields for Variant queries

1.0.0-rc3 (January 2017)

General

Catalog

  • Added support to fetch shared projects and studies.

  • Added organism information to the project data model. (#455arrow-up-right)

  • Renamed diskUsage and diskQuota for size and quota respectively in all data models were present.

  • Closed sessions are now removed from the array of sessions (but they can still be found in the audit collection). (#475arrow-up-right)

Storage

Server

  • Create and update webservices have been all implemented via POST.

Known issues

  • OpenCGA storage hadoop is not available in this version. To compile use this line:

    mvn clean install -DskipTests -pl '!:opencga-storage-hadoop-core'

1.0.0-rc2 (November 2016)

1.0.0-rc1 (September 2016)

This release constitutes the first release candidate (RC1). This is the biggest release ever with more than 1,400 commits, special mention to j-collarrow-up-right and pfurioarrow-up-right for their contribution in Catalog, Storage and Server components.

General

  • New command line interfaces (CLI) for users (opencga.sh), admins (opencga-admin.sh) and analysis (opencga-analysis.sh)

Catalog

  • New catalog configuration file using YAML.

  • New authorisation method. A big list of permission have been defined.

  • New smart id resolver. Numerical ids are no longer mandatory and ids are now resolved internally given the alias.

  • New and improved java and python command lines.

  • New javascript, java and R client implementations.

  • Support for annotations in cohorts.

Storage

  • Many performance improvements and fixes in MongoBD storage engine, the most notable include a new load strategy to improve file merging scalability

  • New storage engine based on Apache HBase, this is completely functional but is tagged as beta until more tests are done.

  • New custom variant annotation implemented

Server

  • An experimental gRPC server implemented

v0.7.0

Third Beta

v0.6.0

Second Beta

v0.5.0

First Beta

  • [IMPROVEMENT] Add direct loader for the first file in a chromosome to load directly to the variants collection (#354arrow-up-right)

Last updated

Was this helpful?