Update README.md
Browse files
README.md
CHANGED
@@ -26,7 +26,7 @@ tags:
|
|
26 |
## Introducing mesh
|
27 |
|
28 |
This is our first ever model! Allow us to explain how the `mesh` architecture works in detail.
|
29 |
-
|
30 |
- Neural Mesh extends the concept of Mixture of Experts by allowing bidirectional expert communication.
|
31 |
|
32 |
- The experts are shared in a bidimensional grid (2x2, 4x4, etc.) layout, that allows for them to communicate with their neighbors using the "Neighbor Exchange" method.
|
|
|
26 |
## Introducing mesh
|
27 |
|
28 |
This is our first ever model! Allow us to explain how the `mesh` architecture works in detail.
|
29 |
+
|
30 |
- Neural Mesh extends the concept of Mixture of Experts by allowing bidirectional expert communication.
|
31 |
|
32 |
- The experts are shared in a bidimensional grid (2x2, 4x4, etc.) layout, that allows for them to communicate with their neighbors using the "Neighbor Exchange" method.
|