cmu-delphi/delphi-epidata

Refactor `csv_importer.py` and `csv_to_database.py` and `covidcast_row.py`

Open

#1,078 opened on Feb 3, 2023

View on GitHub
 (0 comments) (0 reactions) (0 assignees)Python (67 forks)auto 404
acquisitioncode healthgood first issuehelp wantedrefactor

Repository metrics

Stars
 (104 stars)
PR merge metrics
 (PR metrics pending)

Description

A number of refactors can be done here:

  • csv_importer and csv_to_database are tightly coupled, but with low cohesion; would probably be best if merged together
  • csv_importer validation could likely be handled by Pandas exceptions
  • csv_importer can exit early when detecting a Pandas exception and save time
  • csv_importer can probably share validation with covidcast_row

Contributor guide

Research direction
Analyze the tight coupling between csv importer and csv to database, and propose merging them. Review how Pandas exceptions can replace custom validation, and identify shared validation patterns with covidcast row.
Tech stack
python
Domain
backendapidata
Issue type
Refactor
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
Half day
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Mostly clear
Prerequisites
PythonPandas
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
60