Please update shutil.py copyfileobj to include code mentioned in below issues

jschwar313 · June 8, 2023, 8:00pm

I opened two issues regarding copyfileobj that were not bugs, but a fix that was involved helped me figure out I needed a new external drive, since it displayed the error number from the copyfileobj function. I’d like a modified version of this code implemented permanently in shutil.py so others could see if they have the same issue as me. Here are the two issues I opened:

This is the original issue that has the code I was using that Eryksun posted.

github.com/python/cpython

shutil.copyfileobj line 195 OSError Invalid Argument

opened 06:14PM - 09 Sep 22 UTC

closed 12:11AM - 24 Nov 22 UTC

jschwar313

OS-windows topic-IO pending

I have a python process and I received this error under my old python version an…d now under 3.10.7. It's weird because I can just restart the process with the same parameters and it works fine the second time, so I know it's not a coding error. I'm using windows version 10. Python is 64-bit. Here's the stack trace: Traceback (most recent call last): File "C:\Users\jschw\AppData\Local\Programs\Python\Python310\Lib\site-packages\cx_Freeze\initscripts\__startup__.py", line 120, in run module_init.run(name + "__main__") File "C:\Users\jschw\AppData\Local\Programs\Python\Python310\Lib\site-packages\cx_Freeze\initscripts\Console.py", line 16, in run exec(code, module_main.__dict__) File "src\python\aws_copy_backups_main.py", line 394, in <module> File "src\python\aws_copy_backups_main.py", line 353, in main File "C:\Users\jschw\AppData\Local\Programs\Python\Python310\lib\shutil.py", line 195, in copyfileobj buf = fsrc_read(length) OSError: [Errno 22] Invalid argument C:\Windows\system32>pip list Package Version ------------------------- --------- altgraph 0.17.2 boto3 1.24.68 botocore 1.27.68 certifi 2022.6.15 cffi 1.15.1 charset-normalizer 2.1.1 cryptography 38.0.1 cx-Freeze 6.11.1 cx-Logging 3.0 Cython 0.29.32 future 0.18.2 idna 3.3 importlib-metadata 4.12.0 jmespath 1.0.1 lief 0.12.1 packaging 21.3 pefile 2022.5.30 pip 22.2.2 psutil 5.9.2 pycparser 2.21 pyinstaller 5.3 pyinstaller-hooks-contrib 2022.10 pyOpenSSL 22.0.0 pyparsing 3.0.9 python-dateutil 2.8.2 pywin32-ctypes 0.2.0 requests 2.28.1 s3transfer 0.6.0 setuptools 60.10.0 six 1.16.0 urllib3 1.26.12 wheel 0.37.1 zipp 3.8.1 C:\Windows\system32>python --version Python 3.10.7

Here’s the second issue where it happened again. I put the error message in this post, so you can see how it helped me. Also, the code might need to be modified slightly, since it generated an error.

shutil.copyfileobj error continued from previous issue (this can be closed) · Issue #102357 · python/cpython · GitHub

Eriksun said the following to me about this. Maybe he’ll add more:

The ctypes code that I provided was only for debugging purposes.
Python needs to support the C runtime’s _doserrno value (actually it’s a Windows error code) internally for I/O calls such as _wopen(), close(), read(), and write().

Also, the error that you encountered, ERROR_NO_SUCH_DEVICE (433), should be mapped to the C errno value ENOENT (i.e. FileNotFoundError) in PC/errmap.h.