Badsims

/

sentis-phi-3.5-mini-instruct-uint8

like 5

Hi, Thank you for uploading the model and code!

I was messing around with Sentis and updated the code to make it run on the newer version.

• Update code to be compatible with Sentis 2.1.1 (Tested in Unity 6000.0.29f1)
• Replaced TokenizerUtils and Phi3InputFormatter which seem to be missing in the original code

Nice thank you for the conversion! Upon running the generate function im getting this error however:

NullReferenceException: Object reference not set to an instance of an object
Unity.Sentis.ComputeFunction..ctor (UnityEngine.ComputeShader shader, System.String kernelName) (at ./Library/PackageCache/com.unity.sentis@d71b8bd74a3a/Runtime/Core/Backends/GPUCompute/ComputeHelper.ComputeFunctions.cs:389)
Unity.Sentis.ComputeFunctions..cctor () (at ./Library/PackageCache/com.unity.sentis@d71b8bd74a3a/Runtime/Core/Backends/GPUCompute/ComputeHelper.ComputeFunctions.cs:50)
Rethrow as TypeInitializationException: The type initializer for 'Unity.Sentis.ComputeFunctions' threw an exception.
Unity.Sentis.Layers.DequantizeUint8.Execute (Unity.Sentis.ExecutionContext ctx) (at ./Library/PackageCache/com.unity.sentis@d71b8bd74a3a/Runtime/Core/Layers/Layer.Quantization.cs:37)
Unity.Sentis.Worker.Schedule () (at ./Library/PackageCache/com.unity.sentis@d71b8bd74a3a/Runtime/Core/Backends/Worker.cs:221)
Phi3Claude+d__13.MoveNext () (at Assets/Phi3Claude.cs:100)

any idea how this could be fixed?