Python Too Big to File Open Read

In this tutorial, we will be discussing well-nigh handling files and resource in Python. We will write sample codes for different file operations such as read, write, suspend etc. Also, we will see how Python eases reading of big text files and images. We will also bargain with context managers while performing such operations to forestall whatever retentivity leaks.

Open File in Python

We brand a call to buil-in function open() to open a file in Python. This office takes number of arguments only the required parameter is the path to file and returns a file object whose type depends on the mode. Below is the signature of open()

def open(file, fashion='r', buffering=None, encoding=None, errors=None, newline=None, closefd=True):        

In the above definition, file is the path to file.

mode is an optional string that specifies the style in which the file is opened. It defaults to 'r' which means open for reading in text mode. Nosotros volition discuss other modes later.

buffering is an optional integer used to set the buffering policy. Binary files are buffered in stock-still-size chunks.

encoding to tell Python runtime near the encoding used by file. This should merely exist used in text manner.

errors is an optional string that specifies how encoding errors are to be handled---this argument should not be used in binary fashion.

newline controls how universal newlines works.

If closefd is Simulated, the underlying file descriptor will be kept open when the file is airtight.

Python file open modes

Character	Meaning
'r'	open for reading (default)
'w'	open up for writing, truncating the file kickoff
'ten'	create a new file and open it for writing
'a'	open up for writing, appending to the end of the file if it exists
'b'	binary mode
't'	text fashion (default)
'+'	open a disk file for updating (reading and writing)

Instance

f = open('examination.txt', mode= 'wt', encoding= 'utf-8')        

Here, w significant write and t for text. All mode should contain read, write and append mode.

Writing to File in Python

write() function is used to write to a file. It accepts text to be written to the file as an statement. Always remember to use close() methodafter any file performance. This method returns the number of codepoints and non the number of bytes. Below is an example.

f = open('test.txt', fashion= 'wt', encoding= 'utf-8')  f.write('How-do-you-do At that place! ') f.write('I am learning Python \n') f.write('What are you learning?')  f.close()        

Above snippet, creates a file, if it does non exist, and writes given text in it. If exists, it truncates the file and writes the new prepare of text that we provided. If we practice not want to override the text that is already present in the file and so we can use 'a' character meaning append.

While writing or reading files, nosotros tin use seek(0) anytime to move the pointers to the kickoff of the file. Hence, the file write will beginning from the beginning of the file and overrides whatsoever text comes to its identify. It does non override all the text instead information technology overrides the text that is required to adjust the new text.

f = open('test.txt', manner= 'wt', encoding= 'utf-viii')  f.write('Hello At that place! ') f.write('I am learning Python \n') f.seek(0) f.write('overridden ')  f.close()        

While executing above code, Hello In that location will exist overriden past the text 'overridden ' as nosotros moved the pointer to start of the file with seek()

Instead of using write() method, we can too apply writelines() function to write multiple lines at once.

Reading Text File in Python

read() method is used to read file in Python. It accepts an optional parameter as number of characters to read from the file and return the text from the text file or binary data for binary file.

Instance

f = open('examination.txt', mode= 'rt', encoding= 'utf-8') chunk_text = f.read(12) impress(chunk_text) print('*******************') text = f.read() print(text)  f.shut()        

Output

With the get-go read(12) method, it only read 12 characters from the start of the text file and read() returns all the text in a text file.

Hello There! *******************  I am learning Python  What are you learning?        

It is always suggested to read files in clamper if you are non certain most the size of file or the file size is bigger.

We tin can besides read a text file line by line using readline() or readlines(). readlines() method returns all the lines of the text file seperated with line intermission(\n) into a listing whereas readline() reads i line at a time with every line ending with '\northward' except the final line.

Reading Files as Iterator

readlines() function reads all the text at in one case which is non suitable to read large files whereas readline() method can not be used to large files as well as nosotros may non know the iteration we may require to read all the text from a file. To overcome this issue in some way, we can use Iterators to read text from a file. It reads text file with ane line at a fourth dimension till the terminate of the line. Below is an example.

f = open up('test.txt', way= 'rt', encoding= 'utf-8')  for line in f:     print(line, end='')      f.shut()        

Using Context Managers while Reading File

Python provides with block to force the resources cleanup after whatever I/O operations with context-managers.

All the examples shown above uses shut() function to close the I/O operation afterwards completing the read or write performance. Just what if any exception occurs and the close() office is not executed. In that case, there tin exist chance of memory leak. We tin can avoid this by putting close() function within finally block. But Python provides a cleaner manner to achive this using context-managers.

with open up('test.txt', style='rt', encoding='utf-8') as f:     for line in f:         impress(line, cease='')        

Though we have access to file object outside the with cake, we can't perform whatever file operations outside the with cake because the file is already close with the terminate of with block.

Copying 1 File Content to Some other File in Python

We can utilize iterator to read each line from the source file and re-create text content to another file to create a copy or duplicate a file in Python. Below is the sample implementation.

with open('test.txt', style='rt') as f:     with open('test1.txt', mode="wt") as g:         for line in f:             g.write(line)        

Reading and Writing Binary Files or Images in Python

The abstract layer to read and write image or binary file is very similar to read and write text file. We just need to supply the mode of file as binary.

with open('image.PNG', fashion='rb') every bit f:     with open up('image1.PNG', fashion="wb") as g:         for line in f:             one thousand.write(line)        

Reading Large File in Python

Due to in-retentivity contraint or memory leak issues, it is always recommended to read large files in clamper. To read a large file in chunk, nosotros can use read() part with while loop to read some chunk data from a text file at a fourth dimension.

with open('test.txt', mode='rt') every bit f:      text = f.read(100) # Reads the offset 100 character and moves arrow to 101th graphic symbol      while len(text) > 0:         print(text)         text = f.read(100) # Motion pointer to end of adjacent 100 grapheme        

Conclusion

In this tutorial, we discussed treatment files and resources in Python. We implemented sample codes for different file operations such as read, write, append etc. As well, we saw how Python eases reading of big text files and images and used context managers while performing file operations to foreclose any memory leaks.

casontheopect.blogspot.com

Source: https://www.devglan.com/python/file-handling-in-python

Share this post