Skip to content

Magniv Core - A Python-decorator based job orchestration platform. Avoid responsibility handoffs by abstracting infra and DevOps.

License

Notifications You must be signed in to change notification settings

MagnivOrg/magniv-core

Folders and files

NameName
Last commit message
Last commit date

Latest commit

 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 
 

Repository files navigation

One line data science infra.

Build Python Docs Demo with Loom


Magniv is the easiest way to build and deploy data applications, pipelines, or cron-like jobs. A Python decorator based orchestration library at the core, Magniv allows data scientists and developers to schedule arbitrary functions in one line. Monitoring, CI/CD, and compute management all come out of the box using the Magniv in a fully-managed context.

Quickstart ⚡

To get Magniv running with a simple "Hello, World" example, follow these three steps:

1. Install Magniv from pip.

pip install magniv

2. Create /tasks/requirements.txt every Magniv project requires at least one requirements.txt

3. Run the code below as a Python script or in a Python notebook (or in a colab notebook).

from magniv.core import task


@task(schedule="@hourly")
def hello_world():
    print("Hello world")

Why Magniv?

Scheduling is not a new problem. Magniv is designed with data scientists and hackers in mind. No more DAG files and bash scripts. Observability and logging comes out of the box.

Monitoring

Using the Magniv dashboard makes it easy to monitor running jobs. Each Magniv task is displayed with its previous run information, logs, code snippets, and other details. Users also have the ability to disable tasks and manually trigger new runs.

Git CI/CD

Similar to tools like Heroku or Netlify, Magniv sets up a CI/CD pipeline from your GitHub repository. After connecting a Magniv workspace to a GitHub repo, every new commit will trigger a new build and update your tasks.

Code Quality

Before commits, please run:

black . --line-length=98

isort . --profile black --line-length=98

About

Magniv Core - A Python-decorator based job orchestration platform. Avoid responsibility handoffs by abstracting infra and DevOps.

Topics

Resources

License

Stars

Watchers

Forks

Releases

No releases published

Contributors 4

  •  
  •  
  •  
  •  

Languages