pypsa-meets-earth/pypsa-earth

Enable parallelization of powerplantmatching in build_powerplants

Open

#846 opened on Aug 26, 2023

View on GitHub
 (0 comments) (1 reaction) (0 assignees)Python (349 forks)auto 404
datagood first issuehelp wanted

Repository metrics

Stars
 (351 stars)
PR merge metrics
 (Avg merge 28d 15h) (35 merged PRs in 30d)

Description

Describe the feature you'd like to see

It would be nice to enable parallelization of powerplantmatching. This is pretty easy by potentially changing the parameter parallel_duke_processes to true in configs/powerplantmatching_config, however, the option process_limit shall be dynamically changed depending on the thread parameter in snakemake or other option. Personally, I'd be prone to use the thread parameter available from snakemake: when greater than 1, the parallel_duke_processes is dynamically set to true.

Contributor guide

Research direction
Investigate how Snakemake passes the thread parameter and modify the 'powerplantmatching config' to dynamically set 'parallel duke processes' based on this parameter.
Tech stack
python
Domain
backend
Issue type
Feature
DifficultyEstimated implementation difficulty for a new contributor, from 1 for very small changes to 5 for expert-level work.
2
Estimated timeA rough time range for an experienced contributor to investigate, implement, test, and prepare a pull request.
1-3 hours
Activity statusHow available the issue appears right now: fresh, active, stale, blocked, or waiting on maintainer input.
Fresh
ClarityHow clearly the issue explains the expected change, acceptance criteria, and next step.
Clear
Prerequisites
PythonSnakemake
Newbie friendlinessA 1-100 score estimating how approachable this issue is for first-time contributors.
65