Alexander Nozik
8a453bf0b9
# Conflicts: # benchmarks/build.gradle.kts # gradle.properties # kmath-ast/src/jsMain/kotlin/space/kscience/kmath/internal/base64/base64.kt |
||
---|---|---|
.github | ||
.idea | ||
.space | ||
attributes-kt | ||
benchmarks | ||
docs | ||
examples | ||
gradle | ||
kmath-ast | ||
kmath-commons | ||
kmath-complex | ||
kmath-core | ||
kmath-coroutines | ||
kmath-dimensions | ||
kmath-ejml | ||
kmath-for-real | ||
kmath-functions | ||
kmath-geometry | ||
kmath-histograms | ||
kmath-jafama | ||
kmath-jupyter | ||
kmath-kotlingrad | ||
kmath-memory | ||
kmath-multik | ||
kmath-nd4j | ||
kmath-optimization | ||
kmath-stat | ||
kmath-symja | ||
kmath-tensorflow | ||
kmath-tensors | ||
kmath-viktor | ||
license | ||
test-utils | ||
.gitignore | ||
.space.kts | ||
build.gradle.kts | ||
CHANGELOG.md | ||
gradle.properties | ||
gradlew | ||
gradlew.bat | ||
README.md | ||
settings.gradle.kts |
KMath
Could be pronounced as key-math
. The Kotlin Mathematics library was initially intended as a Kotlin-based
analog to Python's NumPy library. Later we found that kotlin is much more flexible language and allows superior
architecture designs. In contrast to numpy
and scipy
it is modular and has a lightweight core. The numpy
-like
experience could be achieved with kmath-for-real extension module.
Publications and talks
- A conceptual article about context-oriented design
- Another article about context-oriented design
- ACAT 2019 conference paper
- A talk at KotlinConf 2019 about using kotlin for science
- A talk on architecture at Joker-2021 (in Russian)
- The same talk in English
- A seminar on tensor API
Goal
- Provide a flexible and powerful API to work with mathematics abstractions in Kotlin-multiplatform (JVM, JS, Native and Wasm).
- Provide basic multiplatform implementations for those abstractions (without significant performance optimization).
- Provide bindings and wrappers with those abstractions for popular optimized platform libraries.
Non-goals
- Be like NumPy. It was the idea at the beginning, but we decided that we can do better in API.
- Provide the best performance out of the box. We have specialized libraries for that. Need only API wrappers for them.
- Cover all cases as immediately and in one bundle. We will modularize everything and add new features gradually.
- Provide specialized behavior in the core. API is made generic on purpose, so one needs to specialize for types, like
for
Double
in the core. For that we will have specialization modules likekmath-for-real
, which will give better experience for those, who want to work with specific types.
Features and stability
KMath is a modular library. Different modules provide different features with different API stability guarantees. All core modules are released with the same version, but with different API change policy. The features are described in module definitions below. The module stability could have the following levels:
- PROTOTYPE. On this level there are no compatibility guarantees. All methods and classes form those modules could break any moment. You can still use it, but be sure to fix the specific version.
- EXPERIMENTAL. The general API is decided, but some changes could be made. Volatile API is marked
with
@UnstableKMathAPI
or other stability warning annotations. - DEVELOPMENT. API breaking generally follows semantic versioning ideology. There could be changes in minor versions, but not in patch versions. API is protected with binary-compatibility-validator tool.
- STABLE. The API stabilized. Breaking changes are allowed only in major releases.
Modules
attributes-kt
An API and basic implementation for arranging objects in a continuous memory block.
Maturity: DEVELOPMENT
benchmarks
Maturity: EXPERIMENTAL
examples
Maturity: EXPERIMENTAL
kmath-ast
Maturity: EXPERIMENTAL
Features:
- expression-language : Expression language and its parser
- mst-jvm-codegen : Dynamic MST to JVM bytecode compiler
- mst-js-codegen : Dynamic MST to JS compiler
- rendering : Extendable MST rendering
kmath-commons
Commons math binding for kmath
Maturity: EXPERIMENTAL
kmath-complex
Complex numbers and quaternions.
Maturity: PROTOTYPE
Features:
- complex : Complex numbers operations
- quaternion : Quaternions and their composition
kmath-core
Core classes, algebra definitions, basic linear algebra
Maturity: DEVELOPMENT
Features:
- algebras : Algebraic structures like rings, spaces and fields.
- nd : Many-dimensional structures and operations on them.
- linear : Basic linear algebra operations (sums, products, etc.), backed by the
Space
API. Advanced linear algebra operations like matrix inversion and LU decomposition.- buffers : One-dimensional structure
- expressions : By writing a single mathematical expression once, users will be able to apply different types of objects to the expression by providing a context. Expressions can be used for a wide variety of purposes from high performance calculations to code generation.
- domains : Domains
- autodiff : Automatic differentiation
- Parallel linear algebra : Parallel implementation for
LinearAlgebra
kmath-coroutines
Maturity: EXPERIMENTAL
kmath-dimensions
A proof of concept module for adding type-safe dimensions to structures
Maturity: PROTOTYPE
kmath-ejml
Maturity: PROTOTYPE
Features:
- ejml-vector : Point implementations.
- ejml-matrix : Matrix implementation.
- ejml-linear-space : LinearSpace implementations.
kmath-for-real
Extension module that should be used to achieve numpy-like behavior. All operations are specialized to work with
Double
numbers without declaring algebraic contexts. One can still use generic algebras though.Maturity: EXPERIMENTAL
Features:
- DoubleVector : Numpy-like operations for Buffers/Points
- DoubleMatrix : Numpy-like operations for 2d real structures
- grids : Uniform grid generators
kmath-functions
Functions, integration and interpolation
Maturity: EXPERIMENTAL
Features:
- piecewise : Piecewise functions.
- polynomials : Polynomial functions.
- linear interpolation : Linear XY interpolator.
- spline interpolation : Cubic spline XY interpolator.
- integration : Univariate and multivariate quadratures
kmath-geometry
Maturity: PROTOTYPE
kmath-histograms
Maturity: PROTOTYPE
kmath-jafama
Jafama integration module
Maturity: DEPRECATED
Features:
- jafama-double : Double ExtendedField implementations based on Jafama
kmath-jupyter
Maturity: PROTOTYPE
kmath-kotlingrad
Kotlin∇ integration module
Maturity: EXPERIMENTAL
Features:
- differentiable-mst-expression : MST based DifferentiableExpression.
- scalars-adapters : Conversions between Kotlin∇'s SFun and MST
kmath-memory
An API and basic implementation for arranging objects in a continuous memory block.
Maturity: DEVELOPMENT
kmath-multik
JetBrains Multik connector
Maturity: PROTOTYPE
kmath-nd4j
ND4J NDStructure implementation and according NDAlgebra classes
Maturity: DEPRECATED
Features:
- nd4jarraystructure : NDStructure wrapper for INDArray
- nd4jarrayrings : Rings over Nd4jArrayStructure of Int and Long
- nd4jarrayfields : Fields over Nd4jArrayStructure of Float and Double
kmath-optimization
Maturity: EXPERIMENTAL
kmath-stat
Maturity: EXPERIMENTAL
kmath-symja
Symja integration module
Maturity: PROTOTYPE
kmath-tensorflow
Google tensorflow connector
Maturity: PROTOTYPE
kmath-tensors
Maturity: PROTOTYPE
Features:
- tensor algebra : Basic linear algebra operations on tensors (plus, dot, etc.)
- tensor algebra with broadcasting : Basic linear algebra operations implemented with broadcasting.
- linear algebra operations : Advanced linear algebra operations like LU decomposition, SVD, etc.
kmath-viktor
Binding for https://github.com/JetBrains-Research/viktor
Maturity: DEPRECATED
test-utils
Maturity: EXPERIMENTAL
Multi-platform support
KMath is developed as a multi-platform library, which means that most of the interfaces are declared in the common source sets and implemented there wherever it is possible. In some cases, features are delegated to platform-specific implementations even if they could be provided in the common module for performance reasons. Currently, Kotlin/JVM is the primary platform, however, Kotlin/Native and Kotlin/JS contributions and feedback are also welcome.
Performance
Calculation of performance is one of the major goals of KMath in the future, but in some cases it is impossible to achieve both performance and flexibility.
We expect to focus on creating a convenient universal API first and then work on increasing performance for specific cases. We expect the worst KMath benchmarks will perform better than native Python, but worse than optimized native/SciPy (mostly due to boxing operations on primitive numbers). The best performance of optimized parts could be better than SciPy.
Requirements
KMath currently relies on JDK 11 for compilation and execution of Kotlin-JVM part. We recommend using GraalVM-CE or Oracle GraalVM for execution to get better performance.
Repositories
Release and development artifacts are accessible from mipt-npm Space
repository https://maven.pkg.jetbrains.space/mipt-npm/p/sci/maven
(see documentation of
Kotlin Multiplatform for more details). The repository could
be reached through repo.kotlin.link proxy:
repositories {
maven("https://repo.kotlin.link")
}
dependencies {
api("space.kscience:kmath-core:$version")
// api("space.kscience:kmath-core-jvm:$version") for jvm-specific version
}
Contributing
The project requires a lot of additional work. The most important thing we need is feedback about what features are required the most. Feel free to create feature requests. We are also welcome to code contributions, especially in issues marked with good first issue label.