Managers

    A Manager is the interface through which database query operations are provided to Django models. At least one Manager exists for every model in a Django application.

    The way Manager classes work is documented in Making queries; this document specifically touches on model options that customize Manager behavior.

    By default, Django adds a Manager with the name objects to every Django model class. However, if you want to use objects as a field name, or if you want to use a name other than objects for the Manager, you can rename it on a per-model basis. To rename the Manager for a given class, define a class attribute of type models.Manager() on that model. For example:

    Using this example model, Person.objects will generate an AttributeError exception, but Person.people.all() will provide a list of all Person objects.

    Custom managers

    You can use a custom Manager in a particular model by extending the base Manager class and instantiating your custom Manager in your model.

    There are two reasons you might want to customize a Manager: to add extra Manager methods, and/or to modify the initial QuerySet the Manager returns.

    Adding extra Manager methods is the preferred way to add “table-level” functionality to your models. (For “row-level” functionality – i.e., functions that act on a single instance of a model object – use Model methods, not custom Manager methods.)

    For example, this custom Manager adds a method with_counts():

    1. from django.db import models
    2. from django.db.models.functions import Coalesce
    3. class PollManager(models.Manager):
    4. def with_counts(self):
    5. return self.annotate(
    6. num_responses=Coalesce(models.Count("response"), 0)
    7. )
    8. class OpinionPoll(models.Model):
    9. question = models.CharField(max_length=200)
    10. objects = PollManager()
    11. class Response(models.Model):
    12. poll = models.ForeignKey(OpinionPoll, on_delete=models.CASCADE)
    13. # ...

    With this example, you’d use OpinionPoll.objects.with_counts() to get a QuerySet of OpinionPoll objects with the extra num_responses attribute attached.

    A custom Manager method can return anything you want. It doesn’t have to return a QuerySet.

    Another thing to note is that Manager methods can access self.model to get the model class to which they’re attached.

    Modifying a manager’s initial QuerySet

    A Manager’s base QuerySet returns all objects in the system. For example, using this model:

    1. from django.db import models
    2. class Book(models.Model):
    3. title = models.CharField(max_length=100)
    4. author = models.CharField(max_length=50)

    …the statement Book.objects.all() will return all books in the database.

    You can override a Manager’s base QuerySet by overriding the Manager.get_queryset() method. get_queryset() should return a QuerySet with the properties you require.

    For example, the following model has two Managers – one that returns all objects, and one that returns only the books by Roald Dahl:

    1. # First, define the Manager subclass.
    2. class DahlBookManager(models.Manager):
    3. def get_queryset(self):
    4. return super().get_queryset().filter(author='Roald Dahl')
    5. # Then hook it into the Book model explicitly.
    6. class Book(models.Model):
    7. author = models.CharField(max_length=50)
    8. objects = models.Manager() # The default manager.
    9. dahl_objects = DahlBookManager() # The Dahl-specific manager.

    With this sample model, Book.objects.all() will return all books in the database, but Book.dahl_objects.all() will only return the ones written by Roald Dahl.

    1. Book.dahl_objects.all()
    2. Book.dahl_objects.filter(title='Matilda')
    3. Book.dahl_objects.count()

    This example also pointed out another interesting technique: using multiple managers on the same model. You can attach as many Manager() instances to a model as you’d like. This is a non-repetitive way to define common “filters” for your models.

    For example:

    1. class AuthorManager(models.Manager):
    2. def get_queryset(self):
    3. return super().get_queryset().filter(role='A')
    4. class EditorManager(models.Manager):
    5. def get_queryset(self):
    6. return super().get_queryset().filter(role='E')
    7. class Person(models.Model):
    8. first_name = models.CharField(max_length=50)
    9. last_name = models.CharField(max_length=50)
    10. role = models.CharField(max_length=1, choices=[('A', _('Author')), ('E', _('Editor'))])
    11. people = models.Manager()
    12. authors = AuthorManager()
    13. editors = EditorManager()

    This example allows you to request Person.authors.all(), Person.editors.all(), and Person.people.all(), yielding predictable results.

    Model._default_manager

    If you use custom Manager objects, take note that the first Manager Django encounters (in the order in which they’re defined in the model) has a special status. Django interprets the first Manager defined in a class as the “default” Manager, and several parts of Django (including dumpdata) will use that Manager exclusively for that model. As a result, it’s a good idea to be careful in your choice of default manager in order to avoid a situation where overriding get_queryset() results in an inability to retrieve objects you’d like to work with.

    You can specify a custom default manager using .

    If you’re writing some code that must handle an unknown model, for example, in a third-party app that implements a generic view, use this manager (or _base_manager) rather than assuming the model has an objects manager.

    Base managers

    Model._base_manager

    By default, Django uses an instance of the Model._base_manager manager class when accessing related objects (i.e. choice.question), not the _default_manager on the related object. This is because Django needs to be able to retrieve the related object, even if it would otherwise be filtered out (and hence be inaccessible) by the default manager.

    If the normal base manager class () isn’t appropriate for your circumstances, you can tell Django which class to use by setting Meta.base_manager_name.

    Base managers aren’t used when querying on related models, or when . For example, if the Question model from the tutorial had a deleted field and a base manager that filters out instances with deleted=True, a queryset like Choice.objects.filter(question__name__startswith='What') would include choices related to deleted questions.

    Don’t filter away any results in this type of manager subclass

    This manager is used to access objects that are related to from some other model. In those situations, Django has to be able to see all the objects for the model it is fetching, so that anything which is referred to can be retrieved.

    Therefore, you should not override get_queryset() to filter out any rows. If you do so, Django will return incomplete results.

    While most methods from the standard QuerySet are accessible directly from the Manager, this is only the case for the extra methods defined on a custom QuerySet if you also implement them on the Manager:

    This example allows you to call both authors() and editors() directly from the manager Person.people.

    Creating a manager with QuerySet methods

    In lieu of the above approach which requires duplicating methods on both the QuerySet and the Manager, can be used to create an instance of Manager with a copy of a custom QuerySet’s methods:

    1. class Person(models.Model):
    2. ...
    3. people = PersonQuerySet.as_manager()

    Not every QuerySet method makes sense at the Manager level; for instance we intentionally prevent the QuerySet.delete() method from being copied onto the Manager class.

    Methods are copied according to the following rules:

    • Public methods are copied by default.
    • Private methods (starting with an underscore) are not copied by default.
    • Methods with a queryset_only attribute set to False are always copied.
    • Methods with a queryset_only attribute set to True are never copied.

    For example:

    1. class CustomQuerySet(models.QuerySet):
    2. def public_method(self):
    3. return
    4. # Available only on QuerySet.
    5. def _private_method(self):
    6. return
    7. # Available only on QuerySet.
    8. def opted_out_public_method(self):
    9. return
    10. opted_out_public_method.queryset_only = True
    11. # Available on both Manager and QuerySet.
    12. def _opted_in_private_method(self):
    13. _opted_in_private_method.queryset_only = False

    from_queryset()

    classmethod from_queryset(queryset_class)

    For advanced usage you might want both a custom Manager and a custom QuerySet. You can do that by calling Manager.from_queryset() which returns a subclass of your base Manager with a copy of the custom QuerySet methods:

    1. class CustomManager(models.Manager):
    2. def manager_only_method(self):
    3. return
    4. class CustomQuerySet(models.QuerySet):
    5. def manager_and_queryset_method(self):
    6. return
    7. class MyModel(models.Model):
    8. objects = CustomManager.from_queryset(CustomQuerySet)()

    You may also store the generated class into a variable:

    1. MyManager = CustomManager.from_queryset(CustomQuerySet)
    2. class MyModel(models.Model):
    3. objects = MyManager()

    Here’s how Django handles custom managers and model inheritance:

    1. Managers from base classes are always inherited by the child class, using Python’s normal name resolution order (names on the child class override all others; then come names on the first parent class, and so on).
    2. If no managers are declared on a model and/or its parents, Django automatically creates the objects manager.
    3. The default manager on a class is either the one chosen with , or the first manager declared on the model, or the default manager of the first parent model.

    These rules provide the necessary flexibility if you want to install a collection of custom managers on a group of models, via an abstract base class, but still customize the default manager. For example, suppose you have this base class:

    1. class AbstractBase(models.Model):
    2. # ...
    3. objects = CustomManager()
    4. class Meta:
    5. abstract = True

    If you use this directly in a subclass, objects will be the default manager if you declare no managers in the base class:

    If you want to inherit from AbstractBase, but provide a different default manager, you can provide the default manager on the child class:

    1. class ChildB(AbstractBase):
    2. # ...
    3. # An explicit default manager.
    4. default_manager = OtherManager()

    Here, default_manager is the default. The objects manager is still available, since it’s inherited, but isn’t used as the default.

    Finally for this example, suppose you want to add extra managers to the child class, but still use the default from AbstractBase. You can’t add the new manager directly in the child class, as that would override the default and you would have to also explicitly include all the managers from the abstract base class. The solution is to put the extra managers in another base class and introduce it into the inheritance hierarchy after the defaults:

    1. class ExtraManager(models.Model):
    2. extra_manager = OtherManager()
    3. class Meta:
    4. abstract = True
    5. class ChildC(AbstractBase, ExtraManager):
    6. # ...
    7. # Default manager is CustomManager, but OtherManager is
    8. # also available via the "extra_manager" attribute.
    9. pass

    Note that while you can define a custom manager on the abstract model, you can’t invoke any methods using the abstract model. That is:

    1. ClassA.objects.do_something()

    is legal, but:

    1. AbstractBase.objects.do_something()

    will raise an exception. This is because managers are intended to encapsulate logic for managing collections of objects. Since you can’t have a collection of abstract objects, it doesn’t make sense to be managing them. If you have functionality that applies to the abstract model, you should put that functionality in a staticmethod or classmethod on the abstract model.

    Implementation concerns

    Whatever features you add to your custom Manager, it must be possible to make a shallow copy of a Manager instance; i.e., the following code must work:

    1. >>> import copy
    2. >>> manager = MyManager()

    This won’t be an issue for most custom managers. If you are just adding simple methods to your Manager, it is unlikely that you will inadvertently make instances of your Manager uncopyable. However, if you’re overriding __getattr__ or some other private method of your object that controls object state, you should ensure that you don’t affect the ability of your Manager to be copied.