When you want to share your Python project, either for private, open-source, or commercial purposes, you need to publish it to PyPI or other package repositories to make it available for other developers. …
In this article, we are going to talk about how to use Elasticsearch in Python. If you have no knowledge about Elasticsearch yet, you can read this article for a quick introduction.
As a data engineer, you may need to create Elasticsearch documents in Python with some scripts. As a…
Python logging: stop using print in your Python code for logging, use the logging module like a pro.
When we write Python programs, we often need to print out the results and also log some exceptions. As a beginner, we would normally use the print function to log everything. It is handy to use the print command but the logs are not stored properly and are difficult to…
We have introduced how to decorate functions in Python in a previous post. If you haven’t checked that post yet, it’s highly recommended to do so because the fundamentals of decorators in Python are introduced in detail in that post. …
A deadlock is a situation when two or more transactions mutually hold and request a lock that the other needs. As a result, a cycle of dependencies is created and the transactions cannot proceed. By default, InnoDB automatically detects deadlocks and rolls back one transaction (the victim) to break the…
Deadlocks are difficult to be totally avoided in transactional databases like InnoDB in MySQL. When you first see a deadlock in your application, you may get scared by its error message and get overwhelmed by the logs shown by SHOW ENGINE INNODB STATUS. …
In your daily development work, it’s common that you accidentally make some mistakes in your Git commits that violate the regulations in your institution. These mistakes can be as minor as embarrassing to your colleagues, or as major as destructive to your application. It would be great if these mistakes…
Kubernetes is an open-source container orchestration system that automates the deployment, scaling, and management of containerized applications. Kubernetes is commonly referred to as k8s for simplicity since there are 8 characters between k and s. …
Redis, which stands for Remote Dictionary Server, is an open-source in-memory data structure store that can be used as an in-memory key-value database, caching system, and pub/sub message broker. …
In our Python code, we often need to specify some sensitive information such as database username, password, API keys, JWT tokens, etc. We should not store any sensitive data as plain texts in our source code repository because they can get leaked easily. A common practice is to store the…
