# Project size increase

**URL:** <https://discuss.python.org/t/project-size-increase/10126>\
**Category:** Packaging\
**Created:** [August 12, 2021, 4:48pm UTC](https://discuss.python.org/t/project-size-increase/10126 "2021-08-12T16:48:31Z")\
**Posts on this page:** 6\
**Page:** 1

<div class="post-metadata">

**Author:** ![rmk135](https://sea2.discourse-cdn.com/flex002/user_avatar/discuss.python.org/rmk135/32/4717_2.png) [@rmk135](https://discuss.python.org/u/rmk135)\
**Post date:** [August 12, 2021, 4:48pm UTC](https://discuss.python.org/t/project-size-increase/10126/1 "2021-08-12T16:48:32Z")

</div>

Hey everybody,

Could anybody take a look on [Limit Request: dependency-injector - 20 000 MB · Issue #1254 · pypa/pypi-support · GitHub](https://github.com/pypa/pypi-support/issues/1254)?

Respectfully,  
Roman

---

<div class="post-metadata">

**Author:** ![cameron](https://sea2.discourse-cdn.com/flex002/user_avatar/discuss.python.org/cameron/32/2658_2.png) [@cameron](https://discuss.python.org/u/cameron)\
**Post date:** [August 12, 2021, 11:27pm UTC](https://discuss.python.org/t/project-size-increase/10126/2 "2021-08-12T23:27:26Z")

</div>

You posted this issue 21 hours ago! Have a little patience. Perhaps the  
relevant person is on the other side of the planet, asleep. Or working  
on their day job. This stuff is almost all run by volunteers.

(There seems nothing unreasonable in the issue itself.)

Cheers,  
Cameron Simpson [cs@cskk.id.au](mailto:cs@cskk.id.au)

---

<div class="post-metadata">

**Author:** ![rmk135](https://sea2.discourse-cdn.com/flex002/user_avatar/discuss.python.org/rmk135/32/4717_2.png) [@rmk135](https://discuss.python.org/u/rmk135)\
**Post date:** [August 13, 2021, 1:01am UTC](https://discuss.python.org/t/project-size-increase/10126/3 "2021-08-13T01:01:44Z")

</div>

Sir, I’m also a person running an open source project after a daily job. I thought we all here are in the same boat. I don’t look for any problems. I look to publish a hofix for another person from our boat. If can you help - please, do. And thank you.

---

<div class="post-metadata">

**Author:** ![cameron](https://sea2.discourse-cdn.com/flex002/user_avatar/discuss.python.org/cameron/32/2658_2.png) [@cameron](https://discuss.python.org/u/cameron)\
**Post date:** [August 13, 2021, 1:46am UTC](https://discuss.python.org/t/project-size-increase/10126/4 "2021-08-13T01:46:42Z")

</div>

We are in the same boat. I’m just pointing out that it is a little early  
to raise the profile of this particular request. The request itself  
looks entirely sensible and reasonable.

Alas, I cannot help you myself.

Cheers,  
Cameron Simpson [cs@cskk.id.au](mailto:cs@cskk.id.au)

---

<div class="post-metadata">

**Author:** ![oscarbenjamin](https://sea2.discourse-cdn.com/flex002/user_avatar/discuss.python.org/oscarbenjamin/32/1209_2.png) [@oscarbenjamin](https://discuss.python.org/u/oscarbenjamin)\
**Post date:** [August 13, 2021, 2:27am UTC](https://discuss.python.org/t/project-size-increase/10126/5 "2021-08-13T02:27:35Z")

</div>

> [@cameron](#):
>
> Alas, I cannot help you myself.

I also can’t help.

> [@cameron](#):
>
> The request itself  
> looks entirely sensible and reasonable.

The issue is that the data stored by the PyPI infrastructure cannot simply scale without bound:

> [@What to do about GPUs? (and the built distributions that support them)](https://discuss.python.org/t/what-to-do-about-gpus-and-the-built-distributions-that-support-them/7125):
>
> I just [rejected](https://github.com/pypa/pypi-support/issues/838) a request for a 2.5GB file size limit on PyPI and think it’s probably time we have a discussion about why and the future of the ecosystem here. File sizes on PyPI have been slowly increasing in size for a while now, mostly driven by certain project’s needs to support specific GPU ABIs. Newer ABIs, like CUDA 11 also seem to be resulting in even larger distributions than before, so this problem is getting worse over time. You can get a sense for overall size of these large projec…

That thread is mainly about distributions with large release files but the most significant issues also apply to projects that have a large number of small release files.

It looks like each release of dependency-injector has over 100 MB of files and there are a few releases each month. The dependency-injector distribution is one of the top data users in PyPI:

> **[Statistics](https://pypi.org/stats/)**
>
> The Python Package Index (PyPI) is a repository of software for the Python programming language.

I’m not any kind of PyPI maintainer so I won’t comment on the reasonableness of the request. I also don’t know anything about dependency-injector but I do wonder whether the project could take another approach that does not involve so many release files needing to be stored in PyPI simultaneously.

---

<div class="post-metadata">

**Author:** ![petersuter](https://avatars.discourse-cdn.com/v4/letter/p/13edae/32.png) [@petersuter](https://discuss.python.org/u/petersuter)\
**Post date:** [August 13, 2021, 6:11am UTC](https://discuss.python.org/t/project-size-increase/10126/6 "2021-08-13T06:11:26Z")

</div>

I also can’t help.

I was just wondering if anyone knows why the Windows / PyPy wheels are apparently 10x smaller than the Linux CPython wheels.

Maybe experimenting with [setting e.g. extra\_link\_args](https://github.com/ets-labs/python-dependency-injector/blob/master/setup.py#L60) as [described here](https://github.com/cython/cython/issues/2102#issuecomment-401603887) would be interesting?
