Aaron Kaulfus (ST11) and Abdelhak Marouane (UAH) participated at the ESDIS SE TIM meeting at Goddard Space Flight Center (GSFC) on 8/16-17/23. The SE TIM brings together experts across the ESDIS project to discuss technical aspects for improving the EOSDIS system. In a joint presentation with the Earthdata Pub project, a data publication service being developed by GHRC and ORNL DAACs, Kaulfus presented on how the Commercial Smallsat Data Acquisition (CSDA) Program data team is leveraging AWS Cognito for authentication of users within its data system. This includes end users for data download as well as vendor data delivery. Marouane presented on a number of topics including using a workflow orchestration tool called Airflow to automate machine learning workflows; the use of lakeFS as a potential framework for an open-source data version control; Streamlit as an alternative to Jupyter notebooks for creating interactive, shareable web applications; and Great Expectations as an open-source Python framework for automated data validation within data production or transformation pipelines.
