Skip to content
New issue

Have a question about this project? Sign up for a free GitHub account to open an issue and contact its maintainers and the community.

By clicking “Sign up for GitHub”, you agree to our terms of service and privacy statement. We’ll occasionally send you account related emails.

Already on GitHub? Sign in to your account

New term - organismStatus #228

Closed
sophiathirza opened this issue May 29, 2019 · 55 comments
Closed

New term - organismStatus #228

sophiathirza opened this issue May 29, 2019 · 55 comments

Comments

@sophiathirza
Copy link

sophiathirza commented May 29, 2019

This proposal is under active development in the 'OSR - How Did It Die?' Task Group.

  • Submitter: Sophia Ratcliffe - NBN Trust (https://nbnatlas.org/)
  • Proponents (at least two independent parties who need this term): I have had requests from several of our data providers asking for the ability to supply and filter records by alive/dead status
  • Justification (why is this term necessary?): We receive many records where the occurrence was of a dead animal and at the moment there is no way store the status of the organism in a DwC term with a controlled vocabulary. It is really important in marine records, which often contain stranding information, and for road kill records.

Proposed definition of the new term:

  • Term name (in lowerCamelCase): organismStatus
  • Class (e.g. Location, Taxon): organism
  • Definition of the term: A description of the status of the organism (alive or dead)
  • Comment (examples, recommendations regarding content, etc.): Recommended best practice is to use a controlled vocabulary, with the terms alive, dead, unknown
  • Refines (identifier of the broader term this term refines, if applicable): Currently we've been using occurrenceRemarks, but it is not easily searchable.
  • Replaces (identifier of the existing term that would be deprecated and replaced by this term, if applicable): N/A
  • ABCD 2.06 (XPATH of the equivalent term in ABCD, if applicable): N/A
@qgroom
Copy link
Member

qgroom commented May 29, 2019

I support the concept, but not so much the suggested name. Status can mean so many things. Can't think of a better one yet.

Also, there is the issue of dead museum specimens and living culture collections. I'm not certain these matter if they are described as dead or alive, as long as it is appropriate, but it is worth considering. I think basisOfRecord is currently used for some of these distinctions.

@sophiathirza
Copy link
Author

Yes, I didn't like using status, but it felt consistent with other DwC terms.

The new term would be used for field observations where the basisOfRecord is HumanObservation (or Occurrence, as some data providers use).

@MattBlissett
Copy link
Member

A possible name could use vitality.

Or viability, which is already used for seed collections (values might be viable, dormant, inviable, dead)

@qgroom
Copy link
Member

qgroom commented May 29, 2019

I like vitality.

@as6699
Copy link

as6699 commented May 29, 2019 via email

@qgroom
Copy link
Member

qgroom commented May 29, 2019

Would reproducing or fertile be appropriate values for this term in that case?

dwc:reproductiveCondition and dwc:lifeStage cover this

@sophiathirza
Copy link
Author

I like vitality

@qgroom
Copy link
Member

qgroom commented May 30, 2019

Could the definition be changed to

An indication of whether the organism was alive or dead at the time of collection or observation.

Comment: Generally Intended to be used with a dwc:basisOfRecord of PreservedSpecimen, MaterialSample, or HumanObservation.

@qgroom
Copy link
Member

qgroom commented May 30, 2019

A further thought

If this field is added to Darwin Core then next obvious need would be causeOfDeath.

Rather than just having a flag to say if something is dead, why not jump straight to a causeOfDeath field with a vocabulary?

@sophiathirza
Copy link
Author

causeOfDeath would be really useful, then we can differentiate strandings, road kills etc.

A single term for vitality, with @qgroom's suggestion for the definition and comment, would still be useful, so that we can easily select all 'dead' records, but if needs be, we can derive that from causeOfDeath.

@qgroom
Copy link
Member

qgroom commented May 30, 2019

I don't like boolean flag fields in the standard when they can be derived from other fields. This doesn't mean they can't be implemented in a database to make searching faster, but as long as they are always derived from one source field there is no danger of a mismatch, where for example one vitality says living, but the cause of death is roadkill.

It is a good question for GBIF though. @MattBlissett was saying dwc:year is derived from dwc:eventdate if it is empty. How much is GBIF willing to add non-standard fields for indexing if they are derived from standard fields?

@stanblum
Copy link
Member

stanblum commented May 31, 2019 via email

@MathildeMousset
Copy link

Potential user here: we work on wild ungulates, and would be interested in vitality and causeOfDeath terms.

Some of our data is road kill data (individual observed dead, with an obvious cause), hunting data (dead animals, through various types of hunting methods), monitoring data (live animals / animals found dead).

@qgroom
Copy link
Member

qgroom commented Jul 9, 2019

The executive of TDWG thinks this is an important issue to consider. The first step would be to engage in discussion with the Darwin Core Maintenance Group to figure out the next steps.

@tucotuco @peterdesmet @mdoering @timrobertson100 @baskaufs @pzermoglio @morr @chicoreus

@chicoreus
Copy link

Consideration by the Darwin Core Maintenance Group should include whether development of this term and a controlled vocabulary of values for it (including the development of user stories and competency questions) would fall within the scope of the maintenance group, or whether this work is of sufficient scope to merit a new task group.

Consideration also needs to be paid to alignment with ABCD, including the PaleontologicalUnit/Preservation/Taphonomy and PaleontologicalUnit/Preservation/Completeness terms.

@baskaufs
Copy link
Contributor

It seems to me that this term should be organized under the Occurrence class rather than Organism. In the thread, we've been talking about the status of the organism at the time when it was observed or collected. That makes it specific to a particular Occurrence of the organism, since an organism can be observed repeatedly and on some of those Occurrences it might have been alive, then dead on its last occurrence (perhaps being made to be dead by the collection).

@tucotuco
Copy link
Member

@baskaufs Agree. Changed label.

@mdoering
Copy link
Contributor

I very much like the term vitality and we should probably think about a short accompanying vocabulary that is more expressive than just the binary dead or alive.

Would you also use it for exuviae or shells?
I found a slide from 2014 about establishmentMeans and its actual content in GBIF which contained a few indications to dead organisms. It seems causeOfDeath is a good company for vitality:

Screenshot 2019-07-31 at 16 12 27

@qgroom
Copy link
Member

qgroom commented Oct 26, 2019

Notes from the Biodiversity Next Unconference 25 October 2019

Vitality & CauseOfDeath

Introduction
Linked to the...

  • decay process
  • health
  • taphonomy
  • species interactions (disease, pests, predators)

Relates to dwc:basisOfRecord

  • PreservedSpecimen
  • FossilSpecimen
  • HumanObservation
  • LivingSpecimen

Use Cases

  • Disease Ecology
  • Causes of death in a living collection (animals and plants)
  • Historical studies
  • The last specimen of an extinct taxon
  • Understanding the genomics of dead organisms (e.g. non-target organisms)
  • Communication with the public about the origins of collections
  • identifying roadkill hotspots
  • Documenting whale strandings
  • Studying the phenology of death
  • Quantifying by-catch in invasive species control programs
  • Reducing unnecessary mortality of endangered species.

Scope

  • When did it die? (also see dwc:GeologicalContext)
  • Collection methods (dwc:samplingProtocol)
  • Should close to death be included?
  • Uncertainty
  • "Natural" versus "unnatural" death
  • Multiple causes of death e.g. killed on road as a cause of blindness caused by disease.

Consider the public sensitivity towards death and killing animals.

Team 1:

  1. Collected Dead
  • "Natural Causes"
  • Predation
  • Storms/weather
  • Disease
  • Age/Senescence

(Fossils: Location)
+Confidence level of above

  1. Killed when collecting
  • Pitfalls
  • Biobanks: alive?
  • Trapped
  • Shot
  • Picked
  • Harvested
  1. Cause of death ambiguous
    Further data needed
    Unsure at time of collecting

Team 2:
#causeOfDeath

  • trapped
  • poisoned
  • starved
  • drowned
  • shot
  • of old age
  • road kill
  • disease
  • weeding
  • collecting
  • burned

Direct cause of death linked to event in time, such as a volcano eruption
Are there pathology ontologies?

Team 3:
SALAFSKY, N. , SALZER, D. , STATTERSFIELD, A. J., HILTON‐TAYLOR, C. , NEUGARTEN, R. , BUTCHART, S. H., COLLEN, B. , COX, N. , MASTER, L. L., O'CONNOR, S. and WILKIE, D. (2008), A Standard Lexicon for Biodiversity Conservation: Unified Classifications of Threats and Actions. Conservation Biology, 22: 897-911. doi:10.1111/j.1523-1739.2008.00937.x

  • Experimental [death]

  • Anthropogenic [death]

  • Biotic/Abiotic [death]

  • Environmental [death]

  • Serves as marker/flag for follow-up in downstream uses

  • medical concepts/terms might already exist

  • 10-20 Use cases to test against

Age at death?
Would it have died anyway?
Whose fault is it?
Collection event

Team 4:
Cause and qualifier
When?

IMG_20191026_123528951
IMG_20191026_123541129
IMG_20191026_123521290

@qgroom
Copy link
Member

qgroom commented Oct 26, 2019

Codes used to express plant losses at Meise Botanic Garden

DIE_WHY_CODES DIE_WHY_CODES DESCRIPTION
D D discarded
ES ES environmental stress (cold, heat, drought)
FR FR failed to root
H H horticultural failure
N N neglect / error
ND ND natural disaster (hurricane, flood, etc.)
P P pest
R R re-accessioned under a new name
RF RF rootstock failure
SO SO sold
V V made into a voucher specimen
NV NV no viable seed
X X not coded
ANS ANS annual - seeds saved but original plants discarded
ANU ANU annual - died after flowering, no viable seed produced
A A animal damage
DI DI disease
FG FG failed to germinate
G G given away
NC NC natural cause (old age, etc.)
O O other
S S stolen
U U unable to locate
W W weeds / competition
VA VA vandalism
SH SH shaded out / overgrown
WT WT changes to water table

@OBISCanada
Copy link

Is it still possible to contribute to this conversation related to OccurrenceStatus. Currently there are 2 terms: present or absent. if an animal/plant is dead it is still present. I would like to propose the addition of a new term called 'trace'. This term could be assigned to observations of shells - these animals should not be flagged as present/dead if the shell is empty. a crab shell can be considered present/dead but an empty snail shell should be flagged as 'trace'.
Other cases where 'trace' could be assigned are when one observes scat, tracks, nests, etc. In these cases there are 'traces' that an animal was present at this location at some time in the past. the animal is not present at the time that the observation was made. It does not imply that the animal is dead.

@qgroom
Copy link
Member

qgroom commented Nov 17, 2019

Many different things are added to the Darwin Core field establishmentMeans and published on GBIF.
This file contains a list of the terms relating to death that have been put in establishmentMeans.
DeadEntriesPutInEstablishmentMeans.xlsx

@qgroom
Copy link
Member

qgroom commented Nov 22, 2019

Causes of Death from the UK Predatory Bird Monitoring Scheme (PBMS)
From Lee A. Walker of the UK's Centre of Ecology and Hydrology.

BOP_USER_BOP_COD_DESC    
COD_ID COD_DESC COD_ABRIDGED
2 Window collision Accident
3 Shot Shot and Special Collection
4 Collision Accident
5 Starvation through injury Accident
6 Unknown Trauma Unknown
7 Disease Starvation and Disease
8 Other trauma Accident
9 Starvation Starvation and Disease
10 Poison Poison
11 Road accident Accident
12 Human predation Accident
13 Animal predation Accident
14 Drowning Accident
15 Experimental collection/Euthenasia Shot and Special Collection
16 Electrocution Accident
1 Unknown Unknown
     

Email from Lee states

Although the CoD list is in our standard operating procedures these are not citable. However the list is published in the supporting documentation for a dataset that we have published in the UK EIDC data catalogue.

The record is here: https://catalogue.ceh.ac.uk/documents/e39e3afb-eb90-4a7d-921d-e03b1a0f414d

The specific file can be accessed through the link below which downloads a zip file. The CoD list is in the column_headings_predatory_bird_livers.csv file.

https://data-package.ceh.ac.uk/sd/e39e3afb-eb90-4a7d-921d-e03b1a0f414d.zip

@albenson-usgs
Copy link

Curious if this has advanced since 2019? I have a dataset of dead marine mammals and seabirds that wash up on shore and I haven't heard a new term has been added.

@sophiathirza
Copy link
Author

It hasn't progressed further than agreeing to set up a task group to explain the rationale of adding new terms for vitality and cause of death and their vocabularies. I've started the charter and meant to send it round to very one for comment. Let me know if you're interested in being involved. Thanks.

@OBISCanada
Copy link

OBISCanada commented May 16, 2020 via email

@qgroom
Copy link
Member

qgroom commented May 16, 2020

To form a TDWG task Group you need to write a charter, something like this...
example charter. You then submit it to the Executive for acceptance. They are unlikely to reject it, but they often have comments and suggestions.

The task group needs to have an umbrella Interest Group, which I guess would be the Observations & Specimens Interest Group.

This little bit of bureaucracy will help you later on when it comes to ratification, because you can show your due diligence on communication with the 'community'.

To expedite the process it might be best to separate vitality from causeOfDeath. I suspect the latter will be more tricky, whereas the former could be proposed in a short paper in BISS.

@sophiathirza
Copy link
Author

@qgroom, sorry for my delay writing the charter. I'll finish it off this week and send it round. Thanks, Sophia

@qgroom
Copy link
Member

qgroom commented May 18, 2020

@sophiathirza that's fantastic! I guess it would be easiest to share it here, but at some point soon we should transition off this issue thread.
Once there is an official task group there can be a TDWG repository for the group to share thoughts and documents.

@sophiathirza
Copy link
Author

The Charter for the new Task Group is attached. Please send me any comments/additions and let me know whether you would like to be added to the list of core members.

I will then submit the final version to TDWG.

Thanks, Sophia

How did it die - task_group_charter.docx

@JohnNichollsTCD
Copy link

JohnNichollsTCD commented Jun 15, 2020 via email

@tucotuco
Copy link
Member

tucotuco commented Jun 15, 2020 via email

@pzermoglio
Copy link
Member

pzermoglio commented Jun 15, 2020

@tucotuco I think it would be appropriate that the Task Group be under the Observations & Specimens Interest Group, as @qgroom suggests. I don't think the Darwin Core Maintenance group should be dealing with this. In cases where new terms (or changes to existing terms) are needed that deal with specific necessities of the community, task groups that are specific to those needs should be under interest groups that are also specific (although less so) to those needs. Maybe in this case is not so obvious, but suppose some other case where paleo terms were needed. One should not expect the DwC MG -or task group within it- to deal with building those terms, their definitions, etc., but rather have the expert groups do it, and come to the DwC MG with a solid, full proposal, for incorporation of new/changed terms.
To put it more briefly, I envision experts in expert groups, and the DwC MG in more of a maintenance/overseeing role. Communication between the groups would of course be of capital importance to the whole process. Also, probably the charter should include a particular task to have the terms ratified in Darwin Core.

As for what the Vocabulary Maintenance Specification says, it could actually happen both ways:

2.1 [...] In the case where a new vocabulary is related to an existing vocabulary having an existing maintaining Interest Group, maintenance of the new vocabulary may be assigned to the existing Interest Group. [...]

2.2 The vocabulary maintenance Interest Group may also establish Task Groups to accomplish broader changes to the standard, such as creating or revising associated documents, or determining how the terms of the vocabulary might be used with a new technology.

@baskaufs Thoughts?

@baskaufs
Copy link
Contributor

My initial thought was that @tucotuco was correct, particularly since the charter describes the creation of two new Darwin Core terms, and that would clearly be the responsibility of the DwC Maintenance Group to shepherd.

However, upon further reflection, I was thinking about the spirit behind section 4 of the VMS. Section 4 describes the development of "vocabulary enhancements". Vocabulary enhancements are defined in section 1.4 and development of controlled vocabularies does not fall within their definition. But the rationale behind section 4 is that when a set of coordinated additions to a vocabulary become complex, it is best to consider them a package that has a higher standard for development and testing than would be necessary for the adoption of a single term. In that situation, the best practice is to document the rationale and implementation testing through the two types of user feedback reports described in section 4.

In Audubon Core, we are currently working three coordinated sets of additions to the standard (a set of terms related to 3D, controlled vocabularies for ac:subjectPart and ac:subjectOrientation, and a set of terms related to sound). Two of these sets of additions have associated task groups chartered under the MG and one does not. But given that they are complex coordinated additions, as AC MG convener, I'm requesting a Feature Report and Implementation Experience Report for all three proposals. The point of those reports is to streamline the adoption process by making it clear during the public comment period and Executive Decision what the proposal is supposed to accomplish and that it actually can accomplish what was proposed.

The last paragraph is somewhat tangential to the question at hand, but the point of section 4 of the VMS is about how to effectively implement changes to a standard that are more complicated than a single term addition. Section 4 specifically allows vocabulary enhancements to be proposed by groups that are NOT task groups chartered by the maintenance group in order to enable those who take initiative and do the work to succeed in improving TDWG vocabularies regardless of whether the maintenance group asked them to do it or not. Given that spirit, if chartering this proposed Task Group under an interest group other than the DwC Maintenance Group is the most effective way to get a good proposal, then I wouldn't oppose that.

The one thing that concerns me a bit about not chartering the Task Group under the Darwin Core MG is wondering how the task group would relate to the Observations and Specimens Group and to the DwC Maintenance Group. The last paragraph of section 4.1 of the VMG describes a back and forth process between the vocabulary MG and the group developing the enhancement, where the MG evaluates how the proposal will fit in with the operation of the existing vocabulary and gives feedback to the TG if it does not think the proposal is ready. The MG essentially acts as the gatekeeper to determine when the proposal is mature enough to advance to public comment. (In this case, the MG is acting in the role that would be assumed by a Review Manager for a new standard.) I'm assuming that if the Observations and Specimens Group Interest group charters this task group, the DwC MG would still operate in this gatekeeper role and that the O&S group would just act in an advisory role for the development of a better proposal. But I think it would be good to be clear about this from the start since we would be potentially creating a gray area if the Task Group is not clear about what their relationship is with the O&S "parent" interest group.

@tucotuco
Copy link
Member

tucotuco commented Jun 16, 2020

Thanks @pzermoglio and @baskaufs. I see what Paula is saying and it makes sense to me, particularly if/since ABCD could benefit from the work as well, and the two standards intend to work toward each other. I had the same concern about interaction with the DwC MG and hoped that something concrete could be in the TG charter about that. I fully support what Steve mentions about how to accomplish that.

@sophiathirza
Copy link
Author

The Task Group has been approved: https://www.tdwg.org/community/osr/how-did-it-die/. Many thanks for your help preparing the charter.

We will have a working session at the TDWG 2020 virtual conference next month to begin work on the terms. It would be great if as many of you as possible could join us.

Thanks again, Sophie

@albenson-usgs
Copy link

Folks in this thread might want to know that the meeting for the working session for this new task group is on Tuesday Sept 22 0800 - 1000 UTC (https://www.tdwg.org/conferences/2020/working-sessions-schedule/). I can't make it at that time (it's 0200 my local time) but I hope others can and that there will be other ways to contribute to the conversation.

@sophiathirza
Copy link
Author

Thanks @albenson-usgs.

I've started an agenda for the working session: https://docs.google.com/document/d/1jvO6yMg0_PZq0KVWTJpk-358UYKkGqkPB-lw80v-3Xc. Once we've agreed the Task Group name we will set up a GitHub repository and we can report back from the session and continue the conversations there. I'm really looking forward to the session.

@albenson-usgs
Copy link

Curious what the status of the task group is? I didn't see a Github repo for it. Would like to watch the repo once it's up. Will someone report here when it is up?

@JohnNichollsTCD
Copy link

Hi Abby - I've not heard anything from the group. I was not included in the meeting(s) and I am not even sure if nay progress has been made. Any repo would be much appreciated.

@sophiathirza
Copy link
Author

Hi Abby,
I asked for the Github repo to be set up after the working session but it's not been created yet. I'll ask again. Thanks for the reminder, Sophie

@sophiathirza
Copy link
Author

The GitHub repo has been set up for the Task Group: https://github.com/tdwg/how-did-it-die. I will copy all the information we have and the feedback from the working session into repo.

@sophiathirza
Copy link
Author

I have put all the information into the GitHub repository (https://github.com/tdwg/how-did-it-die) and it is now open for your contributions and discussions.

The repository is organised following the Collection Descriptions Interest Group (https://github.com/tdwg/cd) repository, hopefully it's clear but do suggest changes if you think something could be improved.

The proposed new properties (one to the core standard and four in a new extension) have separate issues to comment on the name, definition etc: https://github.com/tdwg/how-did-it-die/issues and I've created an issue for each new controlled vocabulary: https://github.com/tdwg/how-did-it-die/issues?q=is%3Aissue+is%3Aopen+label%3Avocabulary linked to a google document to add suggestions. The idea was to keep the vocabulary discussion separate from more general details of the property.

What we need now is:

  • agreement on the new properties (name, definition, whether core or extension)
  • suggestions for controlled vocabulary terms including definitions
  • uses cases to support the new properties and controlled vocabulary terms

Please add use cases as individual issues (https://github.com/tdwg/how-did-it-die/issues); I've added one for the roadkill term to get started: https://github.com/tdwg/how-did-it-die/labels/use%20case. I will move the use cases to the folder in the repository (https://github.com/tdwg/how-did-it-die/tree/main/use_cases) once we've agreed which use cases to include. There is some holding text in the folder for now.

I will arrange a meeting for early May to review the feedback and suggestions and decide how we can start writing it all up. Please let me know if you would like to join the call and what time zone you are in. We may need two calls.

I will write to all the attendees of the working session in TDWG 2020, apologies if you get this twice.

@albenson-usgs
Copy link

I added a use case. I would like to be on the call if we can make it work given different time zones. My time zone is Mountain Daylight Time (GMT -6). Thanks Sophia for all your efforts on this!

@tucotuco tucotuco added the task label Apr 18, 2021
@tucotuco tucotuco changed the title organismStatus - proposal for new term New term - organismStatus May 1, 2021
@sophiathirza
Copy link
Author

We have a zoom call on 16th June at 18:00 CEST to discuss the feedback and suggestions from the GitHub repository (https://github.com/tdwg/how-did-it-die) and to decide how to proceed.

Let me me know if you would like to join. Thanks.

@JohnNichollsTCD
Copy link

JohnNichollsTCD commented Jun 7, 2021 via email

@tucotuco
Copy link
Member

The new term dwc:vitality has been ratified and incorporated in the standard. Closing issue.

Sign up for free to join this conversation on GitHub. Already have an account? Sign in to comment
Projects
None yet
Development

No branches or pull requests