Table of Contents

Codecs

What is a codec

A codec, introduced in Java Edition 1.16, is a specification of conversion between any type of object (such as LootTable, Advancement or BlockPos) and any serialized form (nbt, json, etc.). A codec is a combination of encoder and decoder. An encoder encodes an object to serialized form, and a decoder decodes the serialized from into objects.

For example, loot tables are written in json forms in data packs, and are loaded as LootTable objects in the server. To load loot tables from the jsons in the data pack, the codec is used, to decode from json files to LootTable objects. There are many pre-written codecs in Minecraft, each of which, is used for a specific type of object, but can serialize or deserialize between it and different types of serialized form. For example, LootTable.CODEC can convert LootTable objects into jsons and nbts, and can also convert jsons or nbts into LootTable objects.

Codec was introduced in 1.16, but has mainly been increasingly widely used in Minecraft since 1.20. For example, LootTable, Advancements and Text, are previously serialized or deserialized in other manners in older versions, but now using codecs. Item components, introduced in 1.20.5, also use codecs to serialize and deserialize.

Using a codec

When you serialize or deserialize, you need to specify a DynamicOps, which specifies each concrete action in the serialization or deserialization. The most common used are JsonOps.INSTANCE and NbtOps.INSTANCE. The following code shows an example of converting between BlockPos and NbtElement. 

    // serializing a BlockPos
    final BlockPos blockPos = new BlockPos(1, 2, 3);
    final DataResult<NbtElement> encodeResult = BlockPos.CODEC.encodeStart(NbtOps.INSTANCE, blockPos);
 
    // deserializing a BlockPos
    final NbtList nbtList = new NbtList();
    nbtList.add(NbtInt.of(1));
    nbtList.add(NbtInt.of(2));
    nbtList.add(NbtInt.of(3));
    final DataResult<Pair<BlockPos, NbtElement>> decodeResult = BlockPos.CODEC.decode(NbtOps.INSTANCE, nbtList);

As seen in the code, the result is not directly NbtElement or BlockPos, but a DataResult wrapping them. That's because errors are common in serialization, and instead of exceptions, errors in the data results often happens. You can fetch the result with result() (which may be empty when error happens), or fetch the error message with error() (which may be empty when error does not happen). You can also directly fetch the result with getOrThrow() (or Util.getResult in older versions). 

    // get the result when succeeded
    final NbtList nbtList = new NbtList();
    nbtList.add(NbtInt.of(1));
    nbtList.add(NbtInt.of(2));
    nbtList.add(NbtInt.of(3));
    final DataResult<Pair<BlockPos, NbtElement>> result1 = BlockPos.CODEC.decode(NbtOps.INSTANCE, nbtList);
    System.out.println(result1.getOrThrow().getFirst());
 
    // get the result when error
    final NbtString nbtString = NbtString.of("can't decode me");
    final DataResult<Pair<BlockPos, NbtElement>> result2 = BlockPos.CODEC.decode(NbtOps.INSTANCE, nbtString);
    System.out.println(result2.error().get().message());

There is a special type of DynamicOps, named RegistryOps, which is usually created with RegistryWrapper.getOps. It is a wrapper of other ops, which, when encoding or decoding, behaves basically identical to the wrapped ops, but has some differences: when encoding or decoding some registry entries, it will use the specified RegistryWrapper to get objects or entries, while other ops may directly use the registry or even throw an error.

Writing a codec

Vanilla existing codecs

Mojang has already written many codecs for you. You can directly use them in some cases, and in complex codecs, they may be also useful.

For primitive types, codecs are stored as fields of Codec. For example:

For classes belonging to Minecraft, codecs are stored as their fields. For example:

Besides, Codecs provdes from utilities for codecs. For example:

Tips: You can learn more about how to write codecs by seeing how vanilla codecs are written.

Mapping existing codec

For simple objects, you can directly convert it between those have existing codecs. Mojang provides codecs for all primitive types and common types. In this example, you want to create a codec for Identifier. We just know that it can be converted from and to a String, then we map through xmap: 

    // replace ''Identifier.of'' with ''new Identifier'' for versions before 1.21.
    Codec<Identifier> identifierCodec = Codec.STRING.xmap(s -> Identifier.of(s), identifier -> identifier.toString());

When decoding, the serialized from is converted into string through Codec.STRING, and then converted into Identifier through the first lambda. When encoding, the Identifier is converted into string through the second lambda, and then encoded through Codec.STRING.

If the serialized from is something that cannot be converted into a string, a codec result may be DataResult.Error, and handled properly as expected. However, if you pass a string that cannot be an Identifier, such as NbtString.of(“ABC”), decoding it will directly throw InvalidIdentifierException. Therefore, to handle errors properly, we use flatXmap: 

    Codec<Identifier> identifierCodec = Codec.STRING.flatXmap(s -> {
      try {
        // replace ''Identifier.of'' with ''new Identifier'' for versions before 1.21.
        return DataResult.success(Identifier.of(s));
      } catch (InvalidIdentifierException e) {
        return DataResult.error(() -> "The identifier is invalid:" + e.getMessage());
      }
    }, identifier -> DataResult.success(identifier.toString()));

Note that this time we use flatXmap instead of xmap, in which, the two lambdas returns DataResult. This is used then two lambdas may return failed results. In this case, the second lambda does not fail, so we can also use comapFlatMap: 

    Codec<Identifier> identifierCodec = Codec.STRING.comapFlatMap(s -> {
      try {
        // replace ''Identifier.of'' with ''new Identifier'' for versions before 1.21.
        return DataResult.success(Identifier.of(s));
      } catch (InvalidIdentifierException e) {
        return DataResult.error(() -> "The identifier is invalid:" + e.getMessage());
      }
    }, identifier -> identifier.toString());

Record codec

Required fields

Most objects are complicated, which cannot simply be represented in primitive type. It may be in a form of a map-like object with multiple fields, such as NbtCompound or JsonObject. In this case, you need to specify the fields, including name and codecs of the fields. For example, we create a record type: 

public record Student(String name, int id, Vec3d pos) {
}

To create a codec for this record, we should specify the fields codec, specify how to get fields from a Student object, and specify how to create a Student object from the fields: 

  public static final Codec<Student> CODEC = RecordCodecBuilder.create(i -> i.group(
      Codec.STRING.fieldOf("name").forGetter(Student::name),
      Codec.INT.fieldOf("id").forGetter(Student::id),
      Vec3d.CODEC.fieldOf("pos").forGetter(Student::pos)
  ).apply(i, Student::new));

In this example, the method group takes three fields, specifying each field of the record. The parameter of fieldOf is the name of the field, which represents as keys of the encodec result. The method forGetter specifies how to get the value of the field from the object, such as student → student.name() (in lambda form) or Student::name (in method reference form). The second parameter of apply specified how to convert the field values to a complete object, such as (string, i, vec3d) → new Student(string, i, vec3d).

Let's demonstrate the effect of the codec:

Optional fields

Sometimes all fields are not required. In the previous example, if the encoded result misses some fields, error will be thrown. To make the fields optional, use optionalFieldOf. You also need to specify a default value: 

  public static final Codec<Student> CODEC = RecordCodecBuilder.create(i -> i.group(
      Codec.STRING.fieldOf("name").forGetter(Student::name),
      Codec.INT.optionalFieldOf("id", 0).forGetter(Student::id),
      Vec3d.CODEC.fieldOf("pos").forGetter(Student::pos)
  ).apply(i, Student::new));

In this case, when decoding, when the field id does not exist, the default value 0 will be taken. When encoding, when the field equals to default value 0, it will be missing in the result. For example:

Pay attention to the last example. When decoding, when an optional field has an invalid value, error will be thrown. Howevevr, in older Minecraft versions, when an optional field has an invalid value, the default value will be directly taken.

Note: In current versions, you can also replace optionalFieldOf with lenientOptionalFieldOf, so as to take default values when the value is invalid.

If you do not provide a default value for optionalFieldOf or lenientOptionalFieldOf, it will be a field codec for Optional<T>. For example, if the name of a Student is optional: 

public record Student(Optional<String> name, int id, Vec3d pos) {
  public static final Codec<Student> CODEC = RecordCodecBuilder.create(i -> i.group(
      Codec.STRING.optionalFieldOf("name").forGetter(Student::name),
      Codec.INT.fieldOf("id").forGetter(Student::id),
      Vec3d.CODEC.fieldOf("pos").forGetter(Student::pos)
  ).apply(i, Student::new));
}

Another from of field codec

The codec can also be written like this: 

public record Student(String name, int id, Vec3d pos) {
  public static final Codec<Student> CODEC = RecordCodecBuilder.create(i -> i.apply3(
      Student::new,
      Codec.STRING.fieldOf("name").forGetter(Student::name),
      Codec.INT.fieldOf("id").forGetter(Student::id),
      Vec3d.CODEC.fieldOf("pos").forGetter(Student::pos)
  ));
}

Writing like this may be simpler. You need to specify the method to convert fields to an objects at first (Student::new in this example), and then write field codecs following it, with IDEs able to properly provide suggestions. Remember the method name (apply3 in this example) should contain the number of fields in this situation. For example, sometimes you may also use apply4, apply5, etc. If your record codec contains only one field, use ap.

Dispatching codec

Some objects may not be in fixed structures, but have variant types, each of which, is in a unique structure. Therefore, dispatching codecs are used.

When encoding, the codec gets the type from the object, encode it according to a codec corresponding to the “type”, then encode the type, and finally add the type as a field type of the serialized map-like object. When decoding, obtains and decodes the type from the type field of the map-like object, and then decode it according to the codec corresponding to the type.

Let's take this example: SchoolMember has three types: Student, Teacher and Staff, each of which has a unique structure. 

public interface SchoolMember {
  record Student(String name, int id) implements SchoolMember {}
  record Teacher(String name, String subject, int id) implements SchoolMember {}
  record Staff(String name, String department, Identifier id) implements SchoolMember {}
}

It's easy to know that each type can be created a specific codec (note that it is MapCodec, not Codec): 

public interface SchoolMember {
  record Student(String name, int id) implements SchoolMember {
    public static final MapCodec<Student> CODEC = RecordCodecBuilder.mapCodec(i -> i.group(Codec.STRING.fieldOf("name").forGetter(Student::name), Codec.INT.fieldOf("id").forGetter(Student::id)).apply(i, Student::new));
  }
  // Codecs of other two types are omitted here.
}

We also need to specify a serializable “type” itself. In many cases (such as vanilla LootTable), the type is based on identifier, but in this case we simply use enum. 

public interface SchoolMember {
  @NotNull Type getType();
 
  enum Type implements StringIdentifiable {
    STUDENT("student"), TEACHER("teacher"), STAFF("staff");
    public static final Codec<Type> CODEC = StringIdentifiable.createCodec(Type::values);
    private final String name;
 
    Type(String name) {
      this.name = name;
    }
 
    @Override
    public String asString() {
      return name;
    }
  }
 
  record Student(String name, int id) implements SchoolMember {
    public static final Codec<Student> CODEC = RecordCodecBuilder.create(i -> i.group(Codec.STRING.fieldOf("name").forGetter(Student::name), Codec.INT.fieldOf("id").forGetter(Student::id)).apply(i, Student::new));
 
    @Override
    public @NotNull Type getType() {
      return Type.STUDENT;
    }
  }
 
  // The other two types are omitted here.
}

Now we specified how to get the type from the object. However, it is also required to specify how to get the codec from the type. It can be achieved in many ways, such as storing fields in the type object, or using a map. But in this example, for simplicity, we just use a simple “switch” statements. Then, to create a dispatching codec, invoke method dispatch to the codec of the type: 

  Codec<SchoolMember> CODEC = Type.CODEC.dispatch(SchoolMember::getType, type -> switch (type) {
    case STAFF -> Staff.CODEC;
    case STUDENT -> Student.CODEC;
    case TEACHER -> Teacher.CODEC;
  });

If you need to specify another name of the field, add a string as a first parameter of dispatch method.

Let's see the effect our example:

Note: Actually, in practice, the types can be more complicated. Therefore, you may use registry for types, such as vanilla LootFunctionType, which has a specific registry Registries.LOOT_FUNCTION_TYPE. It is more flexible and extendable.

Packet codec

A packet codec, different from codec, converts between objects and binery packets. It is sometimes similar to codec, and also used in many cases such as item components, but for complex objects, it uses tuples instead of maps. Packet codecs for primitive types are stored in PacketCodecs. We can also use PacketCodec.of to directly specify encoding and decoding. For example: 

public record Student(String name, int id, Vec3d pos) {
  public static final PacketCodec<PacketByteBuf, Student> PACKET_CODEC = PacketCodec.tuple(
      PacketCodecs.STRING, Student::name,
      PacketCodecs.INTEGER, Student::id,
      PacketCodec.of(
          // encoder: writing to the packet
          (value, buf) -> buf.writeDouble(value.x).writeDouble(value.y).writeDouble(value.z),
          // decoder: reading the packet
          buf -> new Vec3d(buf.readDouble(), buf.readDouble(), buf.readDouble())
      ), Student::pos,
      Student::new);
}
Note: Besides PacketByteBuf, you may also sometimes see RegistryByteBuf. Similar to RegistryOps explained before, it works the same as PacketByteBuf, but also provides a registryManager so as to obtain some registry elements.