encodec.cpp

A C++ implementation of Meta's Encodec using Eigen.

Install

Requirements:

• CMake 3.23 or newer
• A C++20 compiler
• Git Large File Storage (LFS)

Using cmake FetchContent:

FetchContent_Declare(
  encodec
  GIT_REPOSITORY https://github.com/pfeatherstone/encodec.cpp.git
  GIT_TAG        <tag-or-commit>
  GIT_SHALLOW    TRUE)

FetchContent_MakeAvailable(encodec)

target_link_libraries(my_24khz_encoder_only_app PRIVATE 
  encodec::encodec 
  encodec::encoder24
  encodec::rvq24)

target_link_libraries(my_24khz_decoder_only_app PRIVATE 
  encodec::encodec 
  encodec::decoder24
  encodec::rvq24)

Using CPM:

CPMAddPackage("gh:pfeatherstone/encodec.cpp#<tag>")

target_link_libraries(my_48khz_app PRIVATE 
  encodec::encodec 
  encodec::encoder48
  encodec::decoder48
  encodec::rvq48)

The encodec::encoder<rate>, encodec::decoder<rate> and encodec::rvq<rate> targets are compiled weight targets.

API

#include <encodec.h>

encodec::encoder enc(encodec::RATE_24KHZ, encodec::get_encoder24_weights(), encodec::get_rvq24_weights());
encodec::decoder dec(encodec::RATE_24KHZ, encodec::get_decoder24_weights(), encodec::get_rvq24_weights());

float audio[24000];
auto  bps{BPS_24000} // BPS_12000, BPS_6000, BPS_3000, BPS_1500
auto [scale, packet]  = enc.encode(audio, bps);
auto audio2           = dec.decode(packet, scale, bps);

Notes

• Model weights are compiled into separate libraries, allowing applications to link only the encoder, decoder, and RVQ weights they require.

• For the 48khz model, you must manually implement streaming for now. Partition your audio into 1s chunks with 10ms overlap. For decoding, use a linear weighting in the overlap regions.

• The 48khz model is really poor when inferring on more than 48000 samples without any partioning. Not surprising as it wasn't trained that way.

Features

• Block based API
• Streaming API

License

This project is licensed under the MIT License. See the LICENSE file for details.

Pretrained weights downloaded by helper scripts are subject to their own licenses. See THIRD_PARTY_NOTICES.md for details.