QuanHoangNgoc/lock_s2t-small-uit-vimd_192355

s2t-small-uit-vimd-finetuned

This model is a fine-tuned version of s2t-small-librispeech-asr on the UIT-ViMD dataset. It achieves the following results on the evaluation set:

• Loss: 1.7059
• Wer: 0.6621

Model description

More information needed

Intended uses & limitations

More information needed

Training and evaluation data

More information needed

Training procedure

Training hyperparameters

The following hyperparameters were used during training:

• learning_rate: 3e-05
• train_batch_size: 16
• eval_batch_size: 16
• seed: 42
• optimizer: Use OptimizerNames.ADAMW_TORCH with betas=(0.9,0.999) and epsilon=1e-08 and optimizer_args=No additional optimizer arguments
• lr_scheduler_type: linear
• lr_scheduler_warmup_steps: 1500
• training_steps: 40000
• mixed_precision_training: Native AMP

Training results

Training Loss	Epoch	Step	Validation Loss	Wer
10.0415	0.0490	46	9.6072	2.7651
9.0102	0.0980	92	8.0153	2.6857
7.5035	0.1470	138	6.5609	1.0961
6.657	0.1960	184	6.2412	2.5347
6.467	0.2449	230	6.1566	2.8444
6.3998	0.2939	276	6.2421	2.7887
6.3478	0.3429	322	6.0328	2.7879
6.315	0.3919	368	6.0488	2.7872
6.2289	0.4409	414	6.0076	2.5553
6.1241	0.4899	460	5.9637	2.6240
6.0459	0.5389	506	5.7459	2.5721
5.9405	0.5879	552	5.6078	1.6834
5.8387	0.6368	598	5.7928	1.6934
5.7766	0.6858	644	5.4501	1.1274
5.6624	0.7348	690	5.2855	1.1091
5.6038	0.7838	736	5.1060	1.2662
5.5032	0.8328	782	5.1984	1.1968
5.4133	0.8818	828	5.2017	1.4813
5.3843	0.9308	874	5.1494	1.3059
5.2971	0.9798	920	5.2455	2.3707
5.2491	1.0288	966	5.1174	1.2235
5.2254	1.0777	1012	5.0736	1.0229
5.194	1.1267	1058	5.0790	1.3837
5.1989	1.1757	1104	4.8743	1.0969
5.1021	1.2247	1150	4.8653	1.1640
5.0841	1.2737	1196	4.6579	1.2822
5.0679	1.3227	1242	4.8070	1.6339
5.0172	1.3717	1288	4.6677	1.0656
4.9715	1.4207	1334	4.6763	2.3150
4.9885	1.4696	1380	4.9263	2.5736
4.9401	1.5186	1426	4.6204	1.9573
4.9149	1.5676	1472	5.0924	1.0267
4.9357	1.6166	1518	4.4960	1.4615
4.8663	1.6656	1564	4.6463	1.4371
4.8719	1.7146	1610	4.4370	2.8726
4.8715	1.7636	1656	4.6787	1.0778
4.809	1.8126	1702	4.4654	1.8726
4.765	1.8616	1748	4.5059	1.6987
4.7921	1.9105	1794	4.6007	2.1129
4.7512	1.9595	1840	4.2819	1.7407
4.7538	2.0085	1886	4.4597	1.6110
4.6738	2.0575	1932	4.3825	1.2044
4.6956	2.1065	1978	4.4944	2.0564
4.6334	2.1555	2024	4.6852	2.3867
4.6504	2.2045	2070	4.5122	1.1098
4.6666	2.2535	2116	4.8208	1.5004
4.6497	2.3024	2162	4.5412	1.9687
4.6257	2.3514	2208	4.1987	2.1243
4.5968	2.4004	2254	4.3092	1.6056
4.6385	2.4494	2300	4.6225	2.0061
4.5742	2.4984	2346	4.4123	1.6285
4.564	2.5474	2392	4.5732	1.1159
4.5809	2.5964	2438	4.8224	2.0870
4.5591	2.6454	2484	4.3851	2.4867
4.5448	2.6944	2530	4.3473	2.1106
4.5179	2.7433	2576	4.3758	1.9252
4.5827	2.7923	2622	4.7695	1.8726
4.5294	2.8413	2668	4.3450	1.7048
4.4741	2.8903	2714	4.1880	1.3837
4.4874	2.9393	2760	4.4765	2.0686
4.4538	2.9883	2806	4.1480	1.9443
4.4028	3.0373	2852	4.3618	1.7376
4.3593	3.0863	2898	3.9405	1.6773
4.3418	3.1353	2944	3.9904	1.5774
4.3513	3.1842	2990	4.3713	1.7605
4.3221	3.2332	3036	4.1550	1.8535
4.3248	3.2822	3082	4.0488	1.6377
4.2307	3.3312	3128	3.8885	1.4600
4.1828	3.3802	3174	4.0612	1.3616
4.1284	3.4292	3220	3.5489	1.3799
4.149	3.4782	3266	3.7420	1.3204
4.0879	3.5272	3312	3.6886	1.4066
4.0178	3.5761	3358	3.4516	1.5187
3.9297	3.6251	3404	3.3175	1.4645
3.8672	3.6741	3450	3.3851	1.1503
3.8899	3.7231	3496	3.4686	1.3394
3.7791	3.7721	3542	3.2141	1.2540
3.7556	3.8211	3588	3.4405	1.1495
3.6788	3.8701	3634	2.9653	1.2456
3.6308	3.9191	3680	3.2929	1.1823
3.6637	3.9681	3726	3.1619	1.0702
3.4924	4.0170	3772	3.0206	0.9779
3.4567	4.0660	3818	3.1071	1.0717
3.3797	4.1150	3864	3.0367	1.1465
3.3936	4.1640	3910	3.1383	1.0557
3.3144	4.2130	3956	2.8800	0.9100
3.2994	4.2620	4002	2.6442	0.9817
3.3083	4.3110	4048	2.7012	0.8696
3.2363	4.3600	4094	2.5279	0.9245
3.2239	4.4089	4140	2.7279	0.8719
3.2264	4.4579	4186	2.5810	0.9382
3.2002	4.5069	4232	2.6343	0.9497
3.1573	4.5559	4278	3.0085	1.0763
3.1325	4.6049	4324	2.6016	0.8978
3.112	4.6539	4370	2.5037	1.1907
3.0337	4.7029	4416	2.2567	1.0725
3.0665	4.7519	4462	2.6845	0.9596
2.9849	4.8009	4508	2.5989	0.9947
3.0215	4.8498	4554	2.5089	1.0
2.9487	4.8988	4600	2.2910	0.9649
2.8958	4.9478	4646	2.3740	1.0427
2.9507	4.9968	4692	2.3876	1.0359
2.8907	5.0458	4738	2.6031	0.9146
2.7608	5.0948	4784	1.9331	0.9977
2.8235	5.1438	4830	2.2818	0.8558
2.8225	5.1928	4876	2.4052	0.9687
2.7794	5.2417	4922	2.0690	0.7246
2.8446	5.2907	4968	2.1208	1.0458
2.7446	5.3397	5014	2.6368	0.9123
2.7906	5.3887	5060	2.3725	0.7635
2.7419	5.4377	5106	1.8286	0.7803
2.7482	5.4867	5152	2.4683	0.7757
2.71	5.5357	5198	2.1428	0.8284
2.748	5.5847	5244	2.4891	0.7521
2.7128	5.6337	5290	2.1653	0.7025
2.6697	5.6826	5336	2.3304	0.7536
2.7055	5.7316	5382	2.1923	0.8314
2.7485	5.7806	5428	1.9645	0.6957
2.6862	5.8296	5474	2.4469	0.7857
2.6268	5.8786	5520	2.0508	0.8223
2.6629	5.9276	5566	3.1371	0.7857
2.7136	5.9766	5612	2.3568	0.8124
2.5939	6.0256	5658	2.2982	0.7902
2.5209	6.0745	5704	2.1673	0.9092
2.5205	6.1235	5750	1.6860	0.8078
2.5426	6.1725	5796	2.5552	0.8223
2.4915	6.2215	5842	2.5377	0.8146
2.5388	6.2705	5888	2.0584	0.9443
2.5655	6.3195	5934	2.1900	0.6613
2.5462	6.3685	5980	1.9014	0.6461
2.4827	6.4175	6026	2.0078	0.7864
2.5831	6.4665	6072	2.0717	0.8002
2.4698	6.5154	6118	2.1906	0.7262
2.4836	6.5644	6164	1.9154	0.8246
2.5318	6.6134	6210	2.1880	0.6133
2.5121	6.6624	6256	1.7957	0.7719
2.468	6.7114	6302	1.9780	0.6522
2.4082	6.7604	6348	1.9565	0.8063
2.4947	6.8094	6394	1.6497	0.7086
2.4975	6.8584	6440	2.3719	0.6659
2.4624	6.9073	6486	1.6827	0.6743
2.4428	6.9563	6532	2.0943	0.6949
2.4522	7.0053	6578	2.1424	0.7483
2.3723	7.0543	6624	1.9519	0.8505
2.3791	7.1033	6670	2.3679	0.7780
2.3894	7.1523	6716	1.5468	0.8047
2.3466	7.2013	6762	1.9894	0.6026
2.3545	7.2503	6808	2.1756	0.8131
2.4152	7.2993	6854	1.6656	0.9161
2.2915	7.3482	6900	2.6449	0.7353
2.3213	7.3972	6946	1.8635	0.6880
2.3227	7.4462	6992	1.9249	0.7590
2.3498	7.4952	7038	2.2339	0.6697
2.3458	7.5442	7084	1.7145	0.6690
2.2996	7.5932	7130	2.0018	0.6384
2.309	7.6422	7176	2.4001	0.6697
2.3566	7.6912	7222	1.9882	0.6827
2.3619	7.7401	7268	2.2134	0.7452
2.3768	7.7891	7314	1.9402	0.6499
2.343	7.8381	7360	2.3600	0.6377
2.3364	7.8871	7406	2.3632	0.7277
2.2965	7.9361	7452	2.0428	0.7597
2.3314	7.9851	7498	1.8117	0.6522
2.2367	8.0341	7544	1.8227	0.7818
2.2004	8.0831	7590	1.8653	0.8986
2.2355	8.1321	7636	1.5815	0.7193
2.2735	8.1810	7682	1.8200	0.7376
2.2016	8.2300	7728	2.1064	0.7757
2.2236	8.2790	7774	2.1960	0.7277
2.2629	8.3280	7820	1.8969	1.0153
2.2333	8.3770	7866	1.9392	0.7780
2.3081	8.4260	7912	2.0788	0.7773
2.2394	8.4750	7958	1.7624	0.8307
2.2689	8.5240	8004	1.6819	0.7483
2.2141	8.5729	8050	2.2714	0.6941
2.2491	8.6219	8096	1.5813	0.8749
2.2547	8.6709	8142	1.7303	0.7376
2.2452	8.7199	8188	2.1367	0.7086
2.1973	8.7689	8234	2.5364	0.7948
2.1983	8.8179	8280	2.5068	0.6560
2.2147	8.8669	8326	1.8437	0.6834
2.1853	8.9159	8372	2.0133	0.5652
2.1776	8.9649	8418	2.0903	0.5866
2.1158	9.0138	8464	1.8758	0.5660
2.1226	9.0628	8510	2.0116	0.7002
2.0988	9.1118	8556	1.7681	0.6041
2.1063	9.1608	8602	2.2456	0.6964
2.0862	9.2098	8648	1.7496	0.5858
2.177	9.2588	8694	1.9786	0.7414
2.113	9.3078	8740	2.1259	0.6987
2.152	9.3568	8786	1.8785	0.7269
2.1315	9.4058	8832	1.9563	0.6911
2.1425	9.4547	8878	1.9474	0.7170
2.1126	9.5037	8924	1.9101	0.7109
2.1793	9.5527	8970	2.1603	0.6895
2.1184	9.6017	9016	1.9047	0.6903
2.1878	9.6507	9062	1.7960	0.6903
2.1172	9.6997	9108	1.9387	0.6842
2.16	9.7487	9154	1.9603	0.5286
2.1817	9.7977	9200	2.0296	0.8032
2.1776	9.8466	9246	2.3591	0.6705
2.1488	9.8956	9292	2.1115	0.6728
2.1173	9.9446	9338	2.0452	0.7879
2.1313	9.9936	9384	1.6271	0.6621
2.0773	10.0426	9430	1.6572	0.5576
2.0741	10.0916	9476	1.7347	0.5736
2.0192	10.1406	9522	1.9669	0.6514
2.0133	10.1896	9568	2.3957	0.5324
2.0137	10.2386	9614	1.9313	0.5523
2.0878	10.2875	9660	1.7588	0.6781
2.0918	10.3365	9706	1.5897	0.6583
2.1368	10.3855	9752	1.8707	0.6552
2.031	10.4345	9798	1.8737	0.6636
2.0823	10.4835	9844	2.0404	0.6705
2.0599	10.5325	9890	2.6899	0.5362
2.0768	10.5815	9936	2.2819	0.6690
2.0301	10.6305	9982	1.8063	0.6636
2.0973	10.6794	10028	1.7077	0.6758
2.0989	10.7284	10074	2.0836	0.6735
2.0378	10.7774	10120	1.9060	0.6659
2.0974	10.8264	10166	2.1084	0.6461
2.054	10.8754	10212	1.7876	0.7994
2.0315	10.9244	10258	1.7286	0.7643
2.0554	10.9734	10304	1.5515	0.6598
2.0493	11.0224	10350	1.7260	0.6529
2.0261	11.0714	10396	1.7375	0.6834
2.0386	11.1203	10442	2.3579	0.6560
1.9837	11.1693	10488	1.7646	0.6529
1.98	11.2183	10534	1.8462	0.6354
2.0112	11.2673	10580	2.2094	0.6354
2.013	11.3163	10626	1.6524	0.7818
1.9644	11.3653	10672	1.9840	0.6400
2.0306	11.4143	10718	1.7322	0.6377
1.9994	11.4633	10764	1.6268	0.6323
1.9911	11.5122	10810	1.5183	0.6423
2.0069	11.5612	10856	1.8589	0.6590
1.9997	11.6102	10902	1.4175	0.6392
2.0322	11.6592	10948	1.7353	0.6461
2.0006	11.7082	10994	1.7597	0.6461
1.9669	11.7572	11040	1.3823	0.6377
1.9959	11.8062	11086	1.8571	0.7048
1.9959	11.8552	11132	1.7335	0.6789
2.0528	11.9042	11178	2.1097	0.6522
2.034	11.9531	11224	1.9425	0.7460
1.9614	12.0021	11270	1.7729	0.6712
1.962	12.0511	11316	1.5280	0.6461
1.9259	12.1001	11362	1.8746	0.6758
1.9713	12.1491	11408	1.8781	0.6209
1.9583	12.1981	11454	1.6248	0.7796
1.9185	12.2471	11500	1.7218	0.8063
1.9682	12.2961	11546	1.6681	0.6491
1.9236	12.3450	11592	1.7581	0.7902
1.9506	12.3940	11638	1.5125	0.7079
1.9488	12.4430	11684	1.2381	0.6568
1.9377	12.4920	11730	2.0817	0.5339
2.0095	12.5410	11776	2.3150	0.6705
1.9564	12.5900	11822	1.9439	0.6499
1.9855	12.6390	11868	1.4350	0.6377
1.9712	12.6880	11914	1.6765	0.5072
1.9449	12.7370	11960	1.6882	0.7429
1.9315	12.7859	12006	2.1650	0.6690
1.9938	12.8349	12052	1.7770	0.5217
1.9731	12.8839	12098	2.0976	0.5217
1.8989	12.9329	12144	1.3949	0.7544
1.9263	12.9819	12190	1.6227	0.6590
1.8839	13.0309	12236	2.0962	0.7620
1.8477	13.0799	12282	1.9402	0.6705
1.901	13.1289	12328	1.8062	0.6354
1.8702	13.1778	12374	2.0144	0.6407
1.8507	13.2268	12420	1.9302	0.6613
1.8718	13.2758	12466	1.7976	0.6316
1.8647	13.3248	12512	1.7692	0.7597
1.9419	13.3738	12558	1.7708	0.7773
1.9313	13.4228	12604	2.2976	0.5645
1.9554	13.4718	12650	1.7321	0.5118
1.9277	13.5208	12696	2.1339	0.6697
1.9022	13.5698	12742	1.7016	0.6445
1.9343	13.6187	12788	1.3628	0.6606
1.8859	13.6677	12834	1.8999	0.5347
1.9809	13.7167	12880	1.7508	0.7849
1.9133	13.7657	12926	1.7578	0.6568
1.8508	13.8147	12972	1.9824	0.6468
1.9198	13.8637	13018	1.7049	0.6430
1.9591	13.9127	13064	2.1335	0.6537
1.9544	13.9617	13110	1.6545	0.6667
1.9176	14.0106	13156	1.8152	0.6606
1.8167	14.0596	13202	1.6567	0.6392
1.8611	14.1086	13248	1.7093	0.6484
1.8082	14.1576	13294	1.7650	0.7216
1.852	14.2066	13340	1.7747	0.6537
1.8505	14.2556	13386	2.0744	0.6438
1.854	14.3046	13432	1.9691	0.6369
1.9041	14.3536	13478	2.0058	0.6438
1.8661	14.4026	13524	1.9013	0.5156
1.8366	14.4515	13570	1.7564	0.7162
1.8687	14.5005	13616	2.0942	0.6499
1.821	14.5495	13662	1.6824	0.6392
1.9413	14.5985	13708	1.5903	0.6247
1.8735	14.6475	13754	1.6288	0.6034
1.8829	14.6965	13800	1.6204	0.6285
1.8803	14.7455	13846	1.4950	0.6423
1.8325	14.7945	13892	1.5955	0.6445
1.905	14.8435	13938	1.7597	0.6308
1.9291	14.8924	13984	1.6754	0.6453
1.8646	14.9414	14030	1.7679	0.6400
1.8707	14.9904	14076	1.4442	0.6430
1.8016	15.0394	14122	2.3060	0.5294
1.787	15.0884	14168	1.5995	0.5393
1.8801	15.1374	14214	1.8316	0.6529
1.837	15.1864	14260	2.0738	0.6400
1.7394	15.2354	14306	1.5721	0.6423
1.8477	15.2843	14352	1.3338	0.6400
1.7935	15.3333	14398	1.9281	0.6468
1.8399	15.3823	14444	1.5838	0.7788
1.8112	15.4313	14490	1.9815	0.6583
1.8274	15.4803	14536	2.2566	0.6575
1.8122	15.5293	14582	2.0499	0.6331
1.8572	15.5783	14628	2.1192	0.6598
1.8645	15.6273	14674	1.6720	0.6423
1.8131	15.6763	14720	1.8248	0.6301
1.8575	15.7252	14766	1.4994	0.6453
1.8619	15.7742	14812	1.6240	0.6438
1.8769	15.8232	14858	1.5106	0.5278
1.8663	15.8722	14904	1.3819	0.6529
1.8752	15.9212	14950	1.3656	0.6568
1.8053	15.9702	14996	1.7036	0.6690
1.8678	16.0192	15042	1.5174	0.6346
1.7752	16.0682	15088	1.4907	0.6537
1.7651	16.1171	15134	1.6303	0.5767
1.757	16.1661	15180	1.7852	0.6781
1.8053	16.2151	15226	1.9609	0.7643
1.8682	16.2641	15272	1.8553	0.7620
1.7658	16.3131	15318	1.4196	0.6468
1.8486	16.3621	15364	1.5508	0.5286
1.8058	16.4111	15410	1.8765	0.6552
1.7903	16.4601	15456	1.4543	0.6362
1.792	16.5091	15502	1.4766	0.7582
1.8187	16.5580	15548	1.6855	0.6545
1.7796	16.6070	15594	1.6344	0.6484
1.8007	16.6560	15640	1.7046	0.6728
1.8026	16.7050	15686	2.1069	0.7346
1.7634	16.7540	15732	1.5729	0.6384
1.8301	16.8030	15778	2.1951	0.6301
1.8223	16.8520	15824	1.6852	0.6423
1.8118	16.9010	15870	2.2032	0.7689
1.816	16.9499	15916	1.7206	0.6537
1.8374	16.9989	15962	1.6348	0.5278
1.7789	17.0479	16008	1.6877	0.6529
1.7469	17.0969	16054	1.7128	0.6331
1.7637	17.1459	16100	1.5377	0.6423
1.7372	17.1949	16146	2.0307	0.6384
1.7499	17.2439	16192	1.7091	0.5111
1.7931	17.2929	16238	2.0855	0.5339
1.7451	17.3419	16284	1.6822	0.6476
1.8153	17.3908	16330	1.7438	0.6560
1.7375	17.4398	16376	1.4717	0.6430
1.7428	17.4888	16422	1.8217	0.6438
1.7769	17.5378	16468	2.3484	0.6484
1.7796	17.5868	16514	1.5592	0.6240
1.7906	17.6358	16560	1.6696	0.5400
1.7823	17.6848	16606	1.8514	0.6415
1.7789	17.7338	16652	1.9547	0.6369
1.7961	17.7827	16698	1.6291	0.6072
1.8065	17.8317	16744	1.7687	0.5118
1.7731	17.8807	16790	1.8033	0.6247
1.7882	17.9297	16836	1.7939	0.6232
1.8064	17.9787	16882	1.5902	0.6217
1.7373	18.0277	16928	1.7263	0.6522
1.6917	18.0767	16974	1.6079	0.6240
1.7446	18.1257	17020	1.7779	0.5004
1.7153	18.1747	17066	1.8259	0.6339
1.7126	18.2236	17112	2.3720	0.6148
1.7564	18.2726	17158	1.7281	0.6209
1.7314	18.3216	17204	1.9946	0.6392
1.7026	18.3706	17250	1.8865	0.5011
1.7182	18.4196	17296	1.9260	0.6171
1.7455	18.4686	17342	1.4056	0.5317
1.7392	18.5176	17388	1.6926	0.7338
1.7899	18.5666	17434	1.8091	0.6240
1.7806	18.6155	17480	1.7749	0.7681
1.7724	18.6645	17526	1.8705	0.7429
1.7587	18.7135	17572	2.3208	0.6331
1.7952	18.7625	17618	1.3462	0.6201
1.7307	18.8115	17664	1.8886	0.6224
1.753	18.8605	17710	1.3937	0.6041
1.7489	18.9095	17756	1.7212	0.6285
1.7813	18.9585	17802	1.4511	0.6339
1.809	19.0075	17848	1.8004	0.7109
1.7159	19.0564	17894	1.3388	0.6217
1.6689	19.1054	17940	1.5340	0.6369
1.7843	19.1544	17986	2.0322	0.6377
1.6666	19.2034	18032	1.6485	0.5050
1.687	19.2524	18078	1.6644	0.6316
1.749	19.3014	18124	1.6634	0.6415
1.7424	19.3504	18170	1.2414	0.6583
1.7427	19.3994	18216	1.6178	0.6194
1.7569	19.4483	18262	1.7098	0.6537
1.7066	19.4973	18308	1.9851	0.6079
1.6939	19.5463	18354	1.5820	0.6461
1.753	19.5953	18400	2.1611	0.6178
1.7409	19.6443	18446	1.6006	0.6293
1.7067	19.6933	18492	1.8803	0.6392
1.7357	19.7423	18538	1.7975	0.6285
1.7447	19.7913	18584	1.2941	0.6262
1.7333	19.8403	18630	1.5589	0.6323
1.6887	19.8892	18676	1.5650	0.6415
1.7471	19.9382	18722	1.8929	0.6354
1.7192	19.9872	18768	1.5802	0.6377
1.663	20.0362	18814	1.8607	0.6476
1.6894	20.0852	18860	1.7199	0.6461
1.6571	20.1342	18906	2.1788	0.5011
1.7115	20.1832	18952	1.6524	0.6484
1.7307	20.2322	18998	1.4865	0.6262
1.6654	20.2812	19044	2.1040	0.6590
1.6871	20.3301	19090	1.6146	0.6468
1.6979	20.3791	19136	1.3820	0.6522
1.7569	20.4281	19182	1.4875	0.6369
1.6833	20.4771	19228	2.1289	0.6316
1.6981	20.5261	19274	1.7743	0.6278
1.6844	20.5751	19320	1.7059	0.6621

Framework versions

• Transformers 4.49.0
• Pytorch 2.6.0+cu124
• Datasets 3.4.0
• Tokenizers 0.21.0