Airflow is great for running huge, complex processes, but can also be a tremendous help even on a small scale. What follows is a step-by-step process that was done as an implementation to handle a lot of the heavy-lifting infrastructure that allows a burgeoning small business to continue to scale. The end result is a single local implementation of Airflow that is automatically running as a daemon process on a local server.
Undoubtedly, Unix has shaped computing and in many ways the world in which we now live. Certainly, a big part of it can be traced back to the fundamental philosophy and guiding principles that shaped Unix development. The abstracted ideas that follow are incredibly powerful in many applications (if not vital) to successful project execution.
“There is no magic! The one basic truth of successful execution bears repeating. There is no magic. There is only logic, common sense, forethought, vast amounts of hard work, and a fanatic dedication to the task at hand”.
“The test of a first-rate intelligence is the ability to hold two opposed ideas in mind at the same time and still retain the ability to function.” – F. Scott Fitzgerald “You never change things by fighting the existing reality. Read more…