metadata

base_model: BAAI/bge-m3
datasets: []
language:
  - en
library_name: sentence-transformers
license: apache-2.0
metrics:
  - cosine_accuracy@3
  - cosine_precision@1
  - cosine_precision@3
  - cosine_precision@5
  - cosine_precision@10
  - cosine_recall@1
  - cosine_recall@3
  - cosine_recall@5
  - cosine_recall@10
  - cosine_ndcg@10
  - cosine_mrr@200
  - cosine_map@100
  - dot_accuracy@3
  - dot_precision@1
  - dot_precision@3
  - dot_precision@5
  - dot_precision@10
  - dot_recall@1
  - dot_recall@3
  - dot_recall@5
  - dot_recall@10
  - dot_ndcg@10
  - dot_mrr@200
  - dot_map@100
pipeline_tag: sentence-similarity
tags:
  - sentence-transformers
  - sentence-similarity
  - feature-extraction
  - generated_from_trainer
  - dataset_size:10359
  - loss:MultipleNegativesRankingLoss
widget:
  - source_sentence: >-
      Cleopatra reacts to the news of Antony's death with a mixture of sadness
      and resignation, contemplating her own mortality and the fickle nature of
      life.
    sentences:
      - >
        Immortal longings in me. Now no more    The juice of Egypt's grape shall
        moist this lip.    Yare, yare, good Iras; quick. Methinks I hear   
        Antony call. I see him rouse himself    To praise my noble act. I hear
        him mock    The luck of Caesar, which the gods give men    To excuse
        their after wrath. Husband, I come.    Now to that name my courage prove
        my title!    I am fire and air; my other elements    I give to baser
        life. So, have you done?    Come then, and take the last warmth of my
        lips.    Farewell, kind Charmian. Iras, long
        farewell.                              [Kisses them. IRAS falls and
        dies]    Have I the aspic in my lips? Dost fall?    If thus thou and
        nature can so gently part,    The stroke of death is as a lover's
        pinch,    Which hurts and is desir'd. Dost thou lie still?    If thou
        vanishest, thou tell'st the world      It is not worth leave-taking. 
        CHARMIAN. Dissolve, thick cloud, and rain, that I may say    The gods
        themselves do weep.  CLEOPATRA. This proves me base.
              If she first meet the curled Antony,
      - |
        BURGUNDY. Warlike and martial Talbot, Burgundy
            Enshrines thee in his heart, and there erects      Thy noble deeds as valour's monuments.  TALBOT. Thanks, gentle Duke. But where is Pucelle now?    I think her old familiar is asleep.    Now where's the Bastard's braves, and Charles his gleeks?    What, all amort? Rouen hangs her head for grief    That such a valiant company are fled.    Now will we take some order in the town,    Placing therein some expert officers;    And then depart to Paris to the King,    For there young Henry with his nobles lie.  BURGUNDY. What Lord Talbot pleaseth Burgundy.  TALBOT. But yet, before we go, let's not forget    The noble Duke of Bedford, late deceas'd,    But see his exequies fulfill'd in Rouen.    A braver soldier never couched lance,    A gentler heart did never sway in court;    But kings and mightiest potentates must die,    For that's the end of human misery.                   Exeunt
      - |
        Your suffering in this dearth, you may as well
            Strike at the heaven with your staves as lift them    Against the Roman state; whose course will on    The way it takes, cracking ten thousand curbs    Of more strong link asunder than can ever    Appear in your impediment. For the dearth,    The gods, not the patricians, make it, and    Your knees to them, not arms, must help. Alack,    You are transported by calamity    Thither where more attends you; and you slander    The helms o' th' state, who care for you like fathers,    When you curse them as enemies.  FIRST CITIZEN. Care for us! True, indeed! They ne'er car'd for us    yet. Suffer us to famish, and their storehouses cramm'd with    grain; make edicts for usury, to support usurers; repeal daily    any wholesome act established against the rich, and provide more    piercing statutes daily to chain up and restrain the poor. If the    wars eat us not up, they will; and there's all the love they bear    us.    MENENIUS. Either you must    Confess yourselves wondrous malicious,    Or be accus'd of folly. I shall tell you    A pretty tale. It may be you have heard it;    But, since it serves my purpose, I will venture    To stale't a little more.  FIRST CITIZEN. Well, I'll hear it, sir; yet you must not think to    fob off our disgrace with a tale. But, an't please you, deliver.  MENENIUS. There was a time when all the body's members    Rebell'd against the belly; thus accus'd it:    That only like a gulf it did remain    I' th' midst o' th' body, idle and unactive,    Still cupboarding the viand, never bearing    Like labour with the rest; where th' other instruments    Did see and hear, devise, instruct, walk, feel,
              And, mutually participate, did minister
  - source_sentence: How does the excerpt reflect themes of loyalty and sacrifice in the play?
    sentences:
      - |
        me a thousand marks in links and torches, walking with thee in
            the night betwixt tavern and tavern; but the sack that thou hast    drunk me would have bought me lights as good cheap at the dearest    chandler's in Europe. I have maintained that salamander of yours      with fire any time this two-and-thirty years. God reward me for    it!  Bard. 'Sblood, I would my face were in your belly!  Fal. God-a-mercy! so should I be sure to be heart-burn'd.
                                  Enter Hostess.    How now, Dame Partlet the hen? Have you enquir'd yet who pick'd
            my pocket?  Host. Why, Sir John, what do you think, Sir John? Do you think I    keep thieves in my house? I have search'd, I have enquired, so    has my husband, man by man, boy by boy, servant by servant. The    tithe of a hair was never lost in my house before.  Fal. Ye lie, hostess. Bardolph was shav'd and lost many a hair, and    I'll be sworn my pocket was pick'd. Go to, you are a woman, go!  Host. Who, I? No; I defy thee! God's light, I was never call'd so    in mine own house before!  Fal. Go to, I know you well enough.  Host. No, Sir John; you do not know me, Sir John. I know you, Sir    John. You owe me money, Sir John, and now you pick a quarrel to      beguile me of it. I bought you a dozen of shirts to your back.  Fal. Dowlas, filthy dowlas! I have given them away to bakers'    wives; they have made bolters of them.  Host. Now, as I am a true woman, holland of eight shillings an ell.    You owe money here besides, Sir John, for your diet and    by-drinkings, and money lent you, four-and-twenty pound.  Fal. He had his part of it; let him pay.  Host. He? Alas, he is poor; he hath nothing.  Fal. How? Poor? Look upon his face. What call you rich? Let them    coin his nose, let them coin his cheeks. I'll not pay a denier.
              What, will you make a younker of me? Shall I not take mine ease
      - |
        EDWARD. I wonder how our princely father scap'd,
            Or whether he be scap'd away or no    From Clifford's and Northumberland's pursuit.    Had he been ta'en, we should have heard the news;    Had he been slain, we should have heard the news;    Or had he scap'd, methinks we should have heard    The happy tidings of his good escape.    How fares my brother? Why is he so sad?  RICHARD. I cannot joy until I be resolv'd    Where our right valiant father is become.    I saw him in the battle range about,    And watch'd him how he singled Clifford forth.    Methought he bore him in the thickest troop    As doth a lion in a herd of neat;
              Or as a bear, encompass'd round with dogs,
            Who having pinch'd a few and made them cry,    The rest stand all aloof and bark at him.      So far'd our father with his enemies;    So fled his enemies my warlike father.    Methinks 'tis prize enough to be his son.    See how the morning opes her golden gates    And takes her farewell of the glorious sun.    How well resembles it the prime of youth,    Trimm'd like a younker prancing to his love!  EDWARD. Dazzle mine eyes, or do I see three suns?  RICHARD. Three glorious suns, each one a perfect sun;    Not separated with the racking clouds,    But sever'd in a pale clear-shining sky.    See, see! they join, embrace, and seem to kiss,    As if they vow'd some league inviolable.    Now are they but one lamp, one light, one sun.    In this the heaven figures some event.  EDWARD. 'Tis wondrous strange, the like yet never heard of.    I think it cites us, brother, to the field,    That we, the sons of brave Plantagenet,    Each one already blazing by our meeds,    Should notwithstanding join our lights together      And overshine the earth, as this the world.    Whate'er it bodes, henceforward will I bear    Upon my target three fair shining suns.  RICHARD. Nay, bear three daughters- by your leave I speak it,    You love the breeder better than the male.
      - |
        Forget that rarest treasure of your cheek,
            Exposing it- but, O, the harder heart!    Alack, no remedy!- to the greedy touch    Of common-kissing Titan, and forget    Your laboursome and dainty trims wherein    You made great Juno angry.  IMOGEN. Nay, be brief;    I see into thy end, and am almost    A man already.  PISANIO. First, make yourself but like one.    Fore-thinking this, I have already fit-    'Tis in my cloak-bag- doublet, hat, hose, all    That answer to them. Would you, in their serving,    And with what imitation you can borrow    From youth of such a season, fore noble Lucius    Present yourself, desire his service, tell him    Wherein you're happy- which will make him know    If that his head have ear in music; doubtless    With joy he will embrace you; for he's honourable,      And, doubling that, most holy. Your means abroad-    You have me, rich; and I will never fail    Beginning nor supplyment.  IMOGEN. Thou art all the comfort    The gods will diet me with. Prithee away!    There's more to be consider'd; but we'll even    All that good time will give us. This attempt    I am soldier to, and will abide it with    A prince's courage. Away, I prithee.  PISANIO. Well, madam, we must take a short farewell,    Lest, being miss'd, I be suspected of    Your carriage from the court. My noble mistress,    Here is a box; I had it from the Queen.    What's in't is precious. If you are sick at sea    Or stomach-qualm'd at land, a dram of this
              Will drive away distemper. To some shade,
            And fit you to your manhood. May the gods    Direct you to the best!  IMOGEN. Amen. I thank thee.                   Exeunt severally
  - source_sentence: >-
      The excerpt showcases the emotional turmoil and sense of honor that drives
      Brutus to take his own life in the face of defeat.
    sentences:
      - |
        Thou know'st that we two went to school together;
            Even for that our love of old, I prithee,    Hold thou my sword-hilts, whilst I run on it.  VOLUMNIUS. That's not an office for a friend, my lord.                                                   Alarum still.  CLITUS. Fly, fly, my lord, there is no tarrying here.  BRUTUS. Farewell to you, and you, and you, Volumnius.    Strato, thou hast been all this while asleep;      Farewell to thee too, Strato. Countrymen,    My heart doth joy that yet in all my life    I found no man but he was true to me.    I shall have glory by this losing day,    More than Octavius and Mark Antony    By this vile conquest shall attain unto.    So, fare you well at once, for Brutus' tongue    Hath almost ended his life's history.    Night hangs upon mine eyes, my bones would rest    That have but labor'd to attain this hour.                            Alarum. Cry within, "Fly, fly, fly!"  CLITUS. Fly, my lord, fly.  BRUTUS. Hence! I will follow.                        Exeunt Clitus, Dardanius, and Volumnius.    I prithee, Strato, stay thou by thy lord.    Thou art a fellow of a good respect;    Thy life hath had some smatch of honor in it.    Hold then my sword, and turn away thy face,    While I do run upon it. Wilt thou, Strato?  STRATO. Give me your hand first. Fare you well, my lord.    BRUTUS. Farewell, good Strato.              Runs on his sword.    Caesar, now be still;    I kill'd not thee with half so good a will.            Dies.
             Alarum. Retreat. Enter Octavius, Antony, Messala,
                         Lucilius, and the Army.
            OCTAVIUS. What man is that?
      - >
        Elsinore. A room in the Castle.

        Enter King, Queen, Polonius, Ophelia, Rosencrantz, Guildenstern, and
        Lords.  King. And can you by no drift of circumstance
            Get from him why he puts on this confusion,    Grating so harshly all his days of quiet    With turbulent and dangerous lunacy?  Ros. He does confess he feels himself distracted,    But from what cause he will by no means speak.  Guil. Nor do we find him forward to be sounded,    But with a crafty madness keeps aloof    When we would bring him on to some confession    Of his true state.  Queen. Did he receive you well?  Ros. Most like a gentleman.  Guil. But with much forcing of his disposition.  Ros. Niggard of question, but of our demands    Most free in his reply.  Queen. Did you assay him      To any pastime?  Ros. Madam, it so fell out that certain players
              We o'erraught on the way. Of these we told him,
      - |
        VII.
        The French camp near Agincourt
        Enter the CONSTABLE OF FRANCE, the LORD RAMBURES, the DUKE OF ORLEANS,
        the DAUPHIN, with others
          CONSTABLE. Tut! I have the best armour of the world.
            Would it were day!  ORLEANS. You have an excellent armour; but let my horse have his    due.  CONSTABLE. It is the best horse of Europe.  ORLEANS. Will it never be morning?  DAUPHIN. My Lord of Orleans and my Lord High Constable, you talk of    horse and armour?  ORLEANS. You are as well provided of both as any prince in the    world.  DAUPHIN. What a long night is this! I will not change my horse with    any that treads but on four pasterns. Ca, ha! he bounds from the    earth as if his entrails were hairs; le cheval volant, the    Pegasus, chez les narines de feu! When I bestride him I soar, I    am a hawk. He trots the air; the earth sings when he touches it;    the basest horn of his hoof is more musical than the pipe of      Hermes.  ORLEANS. He's of the colour of the nutmeg.  DAUPHIN. And of the heat of the ginger. It is a beast for Perseus:    he is pure air and fire; and the dull elements of earth and water    never appear in him, but only in patient stillness while his    rider mounts him; he is indeed a horse, and all other jades you    may call beasts.  CONSTABLE. Indeed, my lord, it is a most absolute and excellent    horse.
            DAUPHIN. It is the prince of palfreys; his neigh is like the
  - source_sentence: What themes are present in the excerpt from the play?
    sentences:
      - >
        Enter TRAVERS  NORTHUMBERLAND. Here comes my servant Travers, whom I
        sent
            On Tuesday last to listen after news.  LORD BARDOLPH. My lord, I over-rode him on the way;    And he is furnish'd with no certainties    More than he haply may retail from me.  NORTHUMBERLAND. Now, Travers, what good tidings comes with you?  TRAVERS. My lord, Sir John Umfrevile turn'd me back    With joyful tidings; and, being better hors'd,    Out-rode me. After him came spurring hard    A gentleman, almost forspent with speed,    That stopp'd by me to breathe his bloodied horse.    He ask'd the way to Chester; and of him    I did demand what news from Shrewsbury.    He told me that rebellion had bad luck,    And that young Harry Percy's spur was cold.      With that he gave his able horse the head    And, bending forward, struck his armed heels
              Against the panting sides of his poor jade
            Up to the rowel-head; and starting so,    He seem'd in running to devour the way,    Staying no longer question.  NORTHUMBERLAND. Ha! Again:    Said he young Harry Percy's spur was cold?    Of Hotspur, Coldspur? that rebellion    Had met ill luck?  LORD BARDOLPH. My lord, I'll tell you what:    If my young lord your son have not the day,    Upon mine honour, for a silken point    I'll give my barony. Never talk of it.  NORTHUMBERLAND. Why should that gentleman that rode by Travers    Give then such instances of loss?  LORD BARDOLPH. Who- he?    He was some hilding fellow that had stol'n    The horse he rode on and, upon my life,    Spoke at a venture. Look, here comes more news.  
                                Enter Morton  NORTHUMBERLAND. Yea, this man's brow, like to a title-leaf,
      - |
        ANTONY. Yet they are not join'd. Where yond pine does stand
            I shall discover all. I'll bring thee word    Straight how 'tis like to go.                           Exit  SCARUS. Swallows have built    In Cleopatra's sails their nests. The augurers    Say they know not, they cannot tell; look grimly,    And dare not speak their knowledge. Antony    Is valiant and dejected; and by starts    His fretted fortunes give him hope and fear    Of what he has and has not.                            [Alarum afar off, as at a sea-fight]
                              Re-enter ANTONY  ANTONY. All is lost!
            This foul Egyptian hath betrayed me.    My fleet hath yielded to the foe, and yonder      They cast their caps up and carouse together    Like friends long lost. Triple-turn'd whore! 'tis thou
              Hast sold me to this novice; and my heart
            Makes only wars on thee. Bid them all fly;    For when I am reveng'd upon my charm,    I have done all. Bid them all fly; begone.       Exit SCARUS    O sun, thy uprise shall I see no more!    Fortune and Antony part here; even here    Do we shake hands. All come to this? The hearts    That spaniel'd me at heels, to whom I gave    Their wishes, do discandy, melt their sweets    On blossoming Caesar; and this pine is bark'd    That overtopp'd them all. Betray'd I am.    O this false soul of Egypt! this grave charm-    Whose eye beck'd forth my wars and call'd them home,    Whose bosom was my crownet, my chief end-    Like a right gypsy hath at fast and loose    Beguil'd me to the very heart of loss.    What, Eros, Eros!                        Enter CLEOPATRA
            Ah, thou spell! Avaunt!
      - |
        TALBOT. Saint George and victory! Fight, soldiers, fight.
            The Regent hath with Talbot broke his word    And left us to the rage of France his sword.    Where is John Talbot? Pause and take thy breath;    I gave thee life and rescu'd thee from death.  JOHN. O, twice my father, twice am I thy son!    The life thou gav'st me first was lost and done    Till with thy warlike sword, despite of fate,    To my determin'd time thou gav'st new date.  TALBOT. When from the Dauphin's crest thy sword struck    fire,    It warm'd thy father's heart with proud desire    Of bold-fac'd victory. Then leaden age,    Quicken'd with youthful spleen and warlike rage,    Beat down Alencon, Orleans, Burgundy,      And from the pride of Gallia rescued thee.    The ireful bastard Orleans, that drew blood    From thee, my boy, and had the maidenhood    Of thy first fight, I soon encountered    And, interchanging blows, I quickly shed    Some of his bastard blood; and in disgrace
              Bespoke him thus: 'Contaminated, base,
  - source_sentence: What is the significance of the tennis balls in the excerpt from the play?
    sentences:
      - |
        My fault is past. But, O, what form of prayer
            Can serve my turn? 'Forgive me my foul murther'?    That cannot be; since I am still possess'd    Of those effects for which I did the murther-    My crown, mine own ambition, and my queen.    May one be pardon'd and retain th' offence?    In the corrupted currents of this world    Offence's gilded hand may shove by justice,    And oft 'tis seen the wicked prize itself    Buys out the law; but 'tis not so above.    There is no shuffling; there the action lies    In his true nature, and we ourselves compell'd,    Even to the teeth and forehead of our faults,    To give in evidence. What then? What rests?    Try what repentance can. What can it not?    Yet what can it when one cannot repent?    O wretched state! O bosom black as death!    O limed soul, that, struggling to be free,    Art more engag'd! Help, angels! Make assay.      Bow, stubborn knees; and heart with strings of steel,    Be soft as sinews of the new-born babe!    All may be well.                                  He kneels.
                                 Enter Hamlet.  Ham. Now might I do it pat, now he is praying;
            And now I'll do't. And so he goes to heaven,    And so am I reveng'd. That would be scann'd.    A villain kills my father; and for that,    I, his sole son, do this same villain send    To heaven.    Why, this is hire and salary, not revenge!    He took my father grossly, full of bread,    With all his crimes broad blown, as flush as May;    And how his audit stands, who knows save heaven?
              But in our circumstance and course of thought,
      - |
        YORK. From Ireland thus comes York to claim his right
            And pluck the crown from feeble Henry's head:    Ring bells aloud, burn bonfires clear and bright,    To entertain great England's lawful king.    Ah, sancta majestas! who would not buy thee dear?    Let them obey that knows not how to rule;    This hand was made to handle nought but gold.    I cannot give due action to my words    Except a sword or sceptre balance it.
              A sceptre shall it have, have I a soul
            On which I'll toss the flower-de-luce of France.
                                 Enter BUCKINGHAM    [Aside] Whom have we here? Buckingham, to disturb me?
            The King hath sent him, sure: I must dissemble.  BUCKINGHAM. York, if thou meanest well I greet thee well.    YORK. Humphrey of Buckingham, I accept thy greeting.    Art thou a messenger, or come of pleasure?  BUCKINGHAM. A messenger from Henry, our dread liege,    To know the reason of these arms in peace;    Or why thou, being a subject as I am,    Against thy oath and true allegiance sworn,    Should raise so great a power without his leave,    Or dare to bring thy force so near the court.  YORK. [Aside] Scarce can I speak, my choler is so great.    O, I could hew up rocks and fight with flint,    I am so angry at these abject terms;    And now, like Ajax Telamonius,    On sheep or oxen could I spend my fury.    I am far better born than is the King,    More like a king, more kingly in my thoughts;    But I must make fair weather yet awhile,    Till Henry be more weak and I more strong.-    Buckingham, I prithee, pardon me    That I have given no answer all this while;    My mind was troubled with deep melancholy.      The cause why I have brought this army hither    Is to remove proud Somerset from the King,    Seditious to his Grace and to the state.  BUCKINGHAM. That is too much presumption on thy part;    But if thy arms be to no other end,    The King hath yielded unto thy demand:
              The Duke of Somerset is in the Tower.
      - |
        Says that you savour too much of your youth,
            And bids you be advis'd there's nought in France    That can be with a nimble galliard won;    You cannot revel into dukedoms there.    He therefore sends you, meeter for your spirit,    This tun of treasure; and, in lieu of this,    Desires you let the dukedoms that you claim    Hear no more of you. This the Dauphin speaks.  KING HENRY. What treasure, uncle?  EXETER. Tennis-balls, my liege.  KING HENRY. We are glad the Dauphin is so pleasant with us;    His present and your pains we thank you for.    When we have match'd our rackets to these balls,      We will in France, by God's grace, play a set    Shall strike his father's crown into the hazard.    Tell him he hath made a match with such a wrangler    That all the courts of France will be disturb'd    With chaces. And we understand him well,    How he comes o'er us with our wilder days,    Not measuring what use we made of them.    We never valu'd this poor seat of England;    And therefore, living hence, did give ourself    To barbarous licence; as 'tis ever common    That men are merriest when they are from home.    But tell the Dauphin I will keep my state,    Be like a king, and show my sail of greatness,    When I do rouse me in my throne of France;    For that I have laid by my majesty    And plodded like a man for working-days;    But I will rise there with so full a glory    That I will dazzle all the eyes of France,    Yea, strike the Dauphin blind to look on us.    And tell the pleasant Prince this mock of his      Hath turn'd his balls to gun-stones, and his soul    Shall stand sore charged for the wasteful vengeance
              That shall fly with them; for many a thousand widows
model-index:
  - name: RAG_general/rerank/models/BAAI-bge-m3-ft
    results:
      - task:
          type: information-retrieval
          name: Information Retrieval
        dataset:
          name: m3 dev
          type: m3-dev
        metrics:
          - type: cosine_accuracy@3
            value: 0.5356211989574283
            name: Cosine Accuracy@3
          - type: cosine_precision@1
            value: 0.4209383145091225
            name: Cosine Precision@1
          - type: cosine_precision@3
            value: 0.17854039965247612
            name: Cosine Precision@3
          - type: cosine_precision@5
            value: 0.11416159860990441
            name: Cosine Precision@5
          - type: cosine_precision@10
            value: 0.06185925282363162
            name: Cosine Precision@10
          - type: cosine_recall@1
            value: 0.4209383145091225
            name: Cosine Recall@1
          - type: cosine_recall@3
            value: 0.5356211989574283
            name: Cosine Recall@3
          - type: cosine_recall@5
            value: 0.5708079930495221
            name: Cosine Recall@5
          - type: cosine_recall@10
            value: 0.6185925282363163
            name: Cosine Recall@10
          - type: cosine_ndcg@10
            value: 0.518363473579454
            name: Cosine Ndcg@10
          - type: cosine_mrr@200
            value: 0.4915925316966444
            name: Cosine Mrr@200
          - type: cosine_map@100
            value: 0.49136031845002553
            name: Cosine Map@100
          - type: dot_accuracy@3
            value: 0.5356211989574283
            name: Dot Accuracy@3
          - type: dot_precision@1
            value: 0.4209383145091225
            name: Dot Precision@1
          - type: dot_precision@3
            value: 0.17854039965247612
            name: Dot Precision@3
          - type: dot_precision@5
            value: 0.11416159860990441
            name: Dot Precision@5
          - type: dot_precision@10
            value: 0.06185925282363162
            name: Dot Precision@10
          - type: dot_recall@1
            value: 0.4209383145091225
            name: Dot Recall@1
          - type: dot_recall@3
            value: 0.5356211989574283
            name: Dot Recall@3
          - type: dot_recall@5
            value: 0.5708079930495221
            name: Dot Recall@5
          - type: dot_recall@10
            value: 0.6185925282363163
            name: Dot Recall@10
          - type: dot_ndcg@10
            value: 0.518363473579454
            name: Dot Ndcg@10
          - type: dot_mrr@200
            value: 0.4915925316966444
            name: Dot Mrr@200
          - type: dot_map@100
            value: 0.49136031845002553
            name: Dot Map@100

RAG_general/rerank/models/BAAI-bge-m3-ft

This is a sentence-transformers model finetuned from BAAI/bge-m3. It maps sentences & paragraphs to a 1024-dimensional dense vector space and can be used for semantic textual similarity, semantic search, paraphrase mining, text classification, clustering, and more.

Model Details

Model Description

Model Type: Sentence Transformer
Base model: BAAI/bge-m3
Maximum Sequence Length: 8192 tokens
Output Dimensionality: 1024 tokens
Similarity Function: Cosine Similarity
Language: en
License: apache-2.0

Model Sources

Documentation: Sentence Transformers Documentation
Repository: Sentence Transformers on GitHub
Hugging Face: Sentence Transformers on Hugging Face

Full Model Architecture

SentenceTransformer(
  (0): Transformer({'max_seq_length': 8192, 'do_lower_case': False}) with Transformer model: XLMRobertaModel 
  (1): Pooling({'word_embedding_dimension': 1024, 'pooling_mode_cls_token': True, 'pooling_mode_mean_tokens': False, 'pooling_mode_max_tokens': False, 'pooling_mode_mean_sqrt_len_tokens': False, 'pooling_mode_weightedmean_tokens': False, 'pooling_mode_lasttoken': False, 'include_prompt': True})
  (2): Normalize()
)

Usage

Direct Usage (Sentence Transformers)

First install the Sentence Transformers library:

pip install -U sentence-transformers

Then you can load this model and run inference.

from sentence_transformers import SentenceTransformer

# Download from the 🤗 Hub
model = SentenceTransformer("rjnClarke/BAAI-bge-m3-fine-tuned")
# Run inference
sentences = [
    'What is the significance of the tennis balls in the excerpt from the play?',
    "Says that you savour too much of your youth,\n    And bids you be advis'd there's nought in France    That can be with a nimble galliard won;    You cannot revel into dukedoms there.    He therefore sends you, meeter for your spirit,    This tun of treasure; and, in lieu of this,    Desires you let the dukedoms that you claim    Hear no more of you. This the Dauphin speaks.  KING HENRY. What treasure, uncle?  EXETER. Tennis-balls, my liege.  KING HENRY. We are glad the Dauphin is so pleasant with us;    His present and your pains we thank you for.    When we have match'd our rackets to these balls,      We will in France, by God's grace, play a set    Shall strike his father's crown into the hazard.    Tell him he hath made a match with such a wrangler    That all the courts of France will be disturb'd    With chaces. And we understand him well,    How he comes o'er us with our wilder days,    Not measuring what use we made of them.    We never valu'd this poor seat of England;    And therefore, living hence, did give ourself    To barbarous licence; as 'tis ever common    That men are merriest when they are from home.    But tell the Dauphin I will keep my state,    Be like a king, and show my sail of greatness,    When I do rouse me in my throne of France;    For that I have laid by my majesty    And plodded like a man for working-days;    But I will rise there with so full a glory    That I will dazzle all the eyes of France,    Yea, strike the Dauphin blind to look on us.    And tell the pleasant Prince this mock of his      Hath turn'd his balls to gun-stones, and his soul    Shall stand sore charged for the wasteful vengeance\n      That shall fly with them; for many a thousand widows\n",
    "YORK. From Ireland thus comes York to claim his right\n    And pluck the crown from feeble Henry's head:    Ring bells aloud, burn bonfires clear and bright,    To entertain great England's lawful king.    Ah, sancta majestas! who would not buy thee dear?    Let them obey that knows not how to rule;    This hand was made to handle nought but gold.    I cannot give due action to my words    Except a sword or sceptre balance it.\n      A sceptre shall it have, have I a soul\n    On which I'll toss the flower-de-luce of France.\n                         Enter BUCKINGHAM    [Aside] Whom have we here? Buckingham, to disturb me?\n    The King hath sent him, sure: I must dissemble.  BUCKINGHAM. York, if thou meanest well I greet thee well.    YORK. Humphrey of Buckingham, I accept thy greeting.    Art thou a messenger, or come of pleasure?  BUCKINGHAM. A messenger from Henry, our dread liege,    To know the reason of these arms in peace;    Or why thou, being a subject as I am,    Against thy oath and true allegiance sworn,    Should raise so great a power without his leave,    Or dare to bring thy force so near the court.  YORK. [Aside] Scarce can I speak, my choler is so great.    O, I could hew up rocks and fight with flint,    I am so angry at these abject terms;    And now, like Ajax Telamonius,    On sheep or oxen could I spend my fury.    I am far better born than is the King,    More like a king, more kingly in my thoughts;    But I must make fair weather yet awhile,    Till Henry be more weak and I more strong.-    Buckingham, I prithee, pardon me    That I have given no answer all this while;    My mind was troubled with deep melancholy.      The cause why I have brought this army hither    Is to remove proud Somerset from the King,    Seditious to his Grace and to the state.  BUCKINGHAM. That is too much presumption on thy part;    But if thy arms be to no other end,    The King hath yielded unto thy demand:\n      The Duke of Somerset is in the Tower.\n",
]
embeddings = model.encode(sentences)
print(embeddings.shape)
# [3, 1024]

# Get the similarity scores for the embeddings
similarities = model.similarity(embeddings, embeddings)
print(similarities.shape)
# [3, 3]

Evaluation

Metrics

Information Retrieval

Dataset: m3-dev
Evaluated with InformationRetrievalEvaluator

Metric	Value
cosine_accuracy@3	0.5356
cosine_precision@1	0.4209
cosine_precision@3	0.1785
cosine_precision@5	0.1142
cosine_precision@10	0.0619
cosine_recall@1	0.4209
cosine_recall@3	0.5356
cosine_recall@5	0.5708
cosine_recall@10	0.6186
cosine_ndcg@10	0.5184
cosine_mrr@200	0.4916
cosine_map@100	0.4914
dot_accuracy@3	0.5356
dot_precision@1	0.4209
dot_precision@3	0.1785
dot_precision@5	0.1142
dot_precision@10	0.0619
dot_recall@1	0.4209
dot_recall@3	0.5356
dot_recall@5	0.5708
dot_recall@10	0.6186
dot_ndcg@10	0.5184
dot_mrr@200	0.4916
dot_map@100	0.4914

Training Details

Training Dataset

Unnamed Dataset

Size: 10,359 training samples
Columns: anchor and positive
Approximate statistics based on the first 1000 samples:
anchor positive
type string string
details
min: 10 tokens
mean: 25.61 tokens
max: 62 tokens

min: 38 tokens
mean: 394.49 tokens
max: 577 tokens

	anchor	positive
type	string	string
details	min: 10 tokens mean: 25.61 tokens max: 62 tokens	min: 38 tokens mean: 394.49 tokens max: 577 tokens

Samples:

anchor	positive
`Who is the general being described in the excerpt?`	PHILO. Nay, but this dotage of our general's O'erflows the measure. Those his goodly eyes, That o'er the files and musters of the war Have glow'd like plated Mars, now bend, now turn, The office and devotion of their view Upon a tawny front. His captain's heart, Which in the scuffles of great fights hath burst The buckles on his breast, reneges all temper, And is become the bellows and the fan To cool a gipsy's lust. Flourish. Enter ANTONY, CLEOPATRA, her LADIES, the train, with eunuchs fanning her Look where they come! Take but good note, and you shall see in him The triple pillar of the world transform'd Into a strumpet's fool. Behold and see. CLEOPATRA. If it be love indeed, tell me how much. ANTONY. There's beggary in the love that can be reckon'd. CLEOPATRA. I'll set a bourn how far to be belov'd. ANTONY. Then must thou needs find out new heaven, new earth. Enter a MESSENGER MESSENGER. News, my good lord, from Rome. ANTONY. Grates me the sum. CLEOPATRA. Nay, hear them, Antony. Fulvia perchance is angry; or who knows If the scarce-bearded Caesar have not sent His pow'rful mandate to you: 'Do this or this; Take in that kingdom and enfranchise that; Perform't, or else we damn thee.' ANTONY. How, my love? CLEOPATRA. Perchance? Nay, and most like, You must not stay here longer; your dismission Is come from Caesar; therefore hear it, Antony. Where's Fulvia's process? Caesar's I would say? Both? Call in the messengers. As I am Egypt's Queen, Thou blushest, Antony, and that blood of thine Is Caesar's homager. Else so thy cheek pays shame When shrill-tongu'd Fulvia scolds. The messengers!
`What is the main conflict highlighted in the excerpt?`	PHILO. Nay, but this dotage of our general's O'erflows the measure. Those his goodly eyes, That o'er the files and musters of the war Have glow'd like plated Mars, now bend, now turn, The office and devotion of their view Upon a tawny front. His captain's heart, Which in the scuffles of great fights hath burst The buckles on his breast, reneges all temper, And is become the bellows and the fan To cool a gipsy's lust. Flourish. Enter ANTONY, CLEOPATRA, her LADIES, the train, with eunuchs fanning her Look where they come! Take but good note, and you shall see in him The triple pillar of the world transform'd Into a strumpet's fool. Behold and see. CLEOPATRA. If it be love indeed, tell me how much. ANTONY. There's beggary in the love that can be reckon'd. CLEOPATRA. I'll set a bourn how far to be belov'd. ANTONY. Then must thou needs find out new heaven, new earth. Enter a MESSENGER MESSENGER. News, my good lord, from Rome. ANTONY. Grates me the sum. CLEOPATRA. Nay, hear them, Antony. Fulvia perchance is angry; or who knows If the scarce-bearded Caesar have not sent His pow'rful mandate to you: 'Do this or this; Take in that kingdom and enfranchise that; Perform't, or else we damn thee.' ANTONY. How, my love? CLEOPATRA. Perchance? Nay, and most like, You must not stay here longer; your dismission Is come from Caesar; therefore hear it, Antony. Where's Fulvia's process? Caesar's I would say? Both? Call in the messengers. As I am Egypt's Queen, Thou blushest, Antony, and that blood of thine Is Caesar's homager. Else so thy cheek pays shame When shrill-tongu'd Fulvia scolds. The messengers!
`The excerpt showcases the tension between Antony's loyalty to Cleopatra and his obligations to Caesar, as well as Cleopatra's influence over him.`	PHILO. Nay, but this dotage of our general's O'erflows the measure. Those his goodly eyes, That o'er the files and musters of the war Have glow'd like plated Mars, now bend, now turn, The office and devotion of their view Upon a tawny front. His captain's heart, Which in the scuffles of great fights hath burst The buckles on his breast, reneges all temper, And is become the bellows and the fan To cool a gipsy's lust. Flourish. Enter ANTONY, CLEOPATRA, her LADIES, the train, with eunuchs fanning her Look where they come! Take but good note, and you shall see in him The triple pillar of the world transform'd Into a strumpet's fool. Behold and see. CLEOPATRA. If it be love indeed, tell me how much. ANTONY. There's beggary in the love that can be reckon'd. CLEOPATRA. I'll set a bourn how far to be belov'd. ANTONY. Then must thou needs find out new heaven, new earth. Enter a MESSENGER MESSENGER. News, my good lord, from Rome. ANTONY. Grates me the sum. CLEOPATRA. Nay, hear them, Antony. Fulvia perchance is angry; or who knows If the scarce-bearded Caesar have not sent His pow'rful mandate to you: 'Do this or this; Take in that kingdom and enfranchise that; Perform't, or else we damn thee.' ANTONY. How, my love? CLEOPATRA. Perchance? Nay, and most like, You must not stay here longer; your dismission Is come from Caesar; therefore hear it, Antony. Where's Fulvia's process? Caesar's I would say? Both? Call in the messengers. As I am Egypt's Queen, Thou blushest, Antony, and that blood of thine Is Caesar's homager. Else so thy cheek pays shame When shrill-tongu'd Fulvia scolds. The messengers!

Loss: MultipleNegativesRankingLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "cos_sim"
}

Evaluation Dataset

Unnamed Dataset

Size: 2,302 evaluation samples
Columns: anchor and positive
Approximate statistics based on the first 1000 samples:
anchor positive
type string string
details
min: 11 tokens
mean: 25.55 tokens
max: 77 tokens

min: 17 tokens
mean: 400.31 tokens
max: 610 tokens

	anchor	positive
type	string	string
details	min: 11 tokens mean: 25.55 tokens max: 77 tokens	min: 17 tokens mean: 400.31 tokens max: 610 tokens

Samples:

anchor	positive
`The excerpt highlights the tension between Antony's loyalty to Cleopatra and his standing in Rome, showcasing the intricate balance of power and love in the play.`	When shrill-tongu'd Fulvia scolds. The messengers! ANTONY. Let Rome in Tiber melt, and the wide arch Of the rang'd empire fall! Here is my space. Kingdoms are clay; our dungy earth alike Feeds beast as man. The nobleness of life Is to do thus [emhracing], when such a mutual pair And such a twain can do't, in which I bind, On pain of punishment, the world to weet We stand up peerless. CLEOPATRA. Excellent falsehood! Why did he marry Fulvia, and not love her? I'll seem the fool I am not. Antony Will be himself. ANTONY. But stirr'd by Cleopatra. Now for the love of Love and her soft hours, Let's not confound the time with conference harsh; There's not a minute of our lives should stretch Without some pleasure now. What sport to-night? CLEOPATRA. Hear the ambassadors. ANTONY. Fie, wrangling queen! Whom everything becomes- to chide, to laugh, To weep; whose every passion fully strives To make itself in thee fair and admir'd. No messenger but thine, and all alone To-night we'll wander through the streets and note The qualities of people. Come, my queen; Last night you did desire it. Speak not to us. Exeunt ANTONY and CLEOPATRA, with the train DEMETRIUS. Is Caesar with Antonius priz'd so slight? PHILO. Sir, sometimes when he is not Antony, He comes too short of that great property Which still should go with Antony. DEMETRIUS. I am full sorry That he approves the common liar, who Thus speaks of him at Rome; but I will hope Of better deeds to-morrow. Rest you happy! Exeunt
`What is the significance of the soothsayer in the context of the play?`	CHARMIAN. Lord Alexas, sweet Alexas, most anything Alexas, almost most absolute Alexas, where's the soothsayer that you prais'd so to th' Queen? O that I knew this husband, which you say must charge his horns with garlands! ALEXAS. Soothsayer! SOOTHSAYER. Your will? CHARMIAN. Is this the man? Is't you, sir, that know things? SOOTHSAYER. In nature's infinite book of secrecy A little I can read. ALEXAS. Show him your hand. Enter ENOBARBUS ENOBARBUS. Bring in the banquet quickly; wine enough Cleopatra's health to drink. CHARMIAN. Good, sir, give me good fortune. SOOTHSAYER. I make not, but foresee. CHARMIAN. Pray, then, foresee me one. SOOTHSAYER. You shall be yet far fairer than you are. CHARMIAN. He means in flesh. IRAS. No, you shall paint when you are old. CHARMIAN. Wrinkles forbid! ALEXAS. Vex not his prescience; be attentive. CHARMIAN. Hush! SOOTHSAYER. You shall be more beloving than beloved.
`What is the setting of the scene in which the excerpt takes place?`	sweet Isis, I beseech thee! And let her die too, and give him a worse! And let worse follow worse, till the worst of all follow him laughing to his grave, fiftyfold a cuckold! Good Isis, hear me this prayer, though thou deny me a matter of more weight; good Isis, I beseech thee! IRAS. Amen. Dear goddess, hear that prayer of the people! For, as it is a heartbreaking to see a handsome man loose-wiv'd, so it is a deadly sorrow to behold a foul knave uncuckolded. Therefore, dear Isis, keep decorum, and fortune him accordingly! CHARMIAN. Amen. ALEXAS. Lo now, if it lay in their hands to make me a cuckold, they would make themselves whores but they'ld do't! Enter CLEOPATRA ENOBARBUS. Hush! Here comes Antony. CHARMIAN. Not he; the Queen. CLEOPATRA. Saw you my lord? ENOBARBUS. No, lady. CLEOPATRA. Was he not here? CHARMIAN. No, madam. CLEOPATRA. He was dispos'd to mirth; but on the sudden A Roman thought hath struck him. Enobarbus! ENOBARBUS. Madam? CLEOPATRA. Seek him, and bring him hither. Where's Alexas? ALEXAS. Here, at your service. My lord approaches. Enter ANTONY, with a MESSENGER and attendants CLEOPATRA. We will not look upon him. Go with us. Exeunt CLEOPATRA, ENOBARBUS, and the rest MESSENGER. Fulvia thy wife first came into the field. ANTONY. Against my brother Lucius? MESSENGER. Ay. But soon that war had end, and the time's state

Loss: MultipleNegativesRankingLoss with these parameters:

{
    "scale": 20.0,
    "similarity_fct": "cos_sim"
}

Training Hyperparameters

Non-Default Hyperparameters

eval_strategy: epoch
gradient_accumulation_steps: 2
learning_rate: 1e-05
weight_decay: 5e-05
warmup_steps: 50
fp16: True
half_precision_backend: True
load_best_model_at_end: True
fp16_backend: True
batch_sampler: no_duplicates

All Hyperparameters

Click to expand

overwrite_output_dir: False
do_predict: False
eval_strategy: epoch
prediction_loss_only: True
per_device_train_batch_size: 8
per_device_eval_batch_size: 8
per_gpu_train_batch_size: None
per_gpu_eval_batch_size: None
gradient_accumulation_steps: 2
eval_accumulation_steps: None
torch_empty_cache_steps: None
learning_rate: 1e-05
weight_decay: 5e-05
adam_beta1: 0.9
adam_beta2: 0.999
adam_epsilon: 1e-08
max_grad_norm: 1.0
num_train_epochs: 3
max_steps: -1
lr_scheduler_type: linear
lr_scheduler_kwargs: {}
warmup_ratio: 0.0
warmup_steps: 50
log_level: passive
log_level_replica: warning
log_on_each_node: True
logging_nan_inf_filter: True
save_safetensors: True
save_on_each_node: False
save_only_model: False
restore_callback_states_from_checkpoint: False
no_cuda: False
use_cpu: False
use_mps_device: False
seed: 42
data_seed: None
jit_mode_eval: False
use_ipex: False
bf16: False
fp16: True
fp16_opt_level: O1
half_precision_backend: True
bf16_full_eval: False
fp16_full_eval: False
tf32: None
local_rank: 0
ddp_backend: None
tpu_num_cores: None
tpu_metrics_debug: False
debug: []
dataloader_drop_last: False
dataloader_num_workers: 0
dataloader_prefetch_factor: None
past_index: -1
disable_tqdm: False
remove_unused_columns: True
label_names: None
load_best_model_at_end: True
ignore_data_skip: False
fsdp: []
fsdp_min_num_params: 0
fsdp_config: {'min_num_params': 0, 'xla': False, 'xla_fsdp_v2': False, 'xla_fsdp_grad_ckpt': False}
fsdp_transformer_layer_cls_to_wrap: None
accelerator_config: {'split_batches': False, 'dispatch_batches': None, 'even_batches': True, 'use_seedable_sampler': True, 'non_blocking': False, 'gradient_accumulation_kwargs': None}
deepspeed: None
label_smoothing_factor: 0.0
optim: adamw_torch
optim_args: None
adafactor: False
group_by_length: False
length_column_name: length
ddp_find_unused_parameters: None
ddp_bucket_cap_mb: None
ddp_broadcast_buffers: False
dataloader_pin_memory: True
dataloader_persistent_workers: False
skip_memory_metrics: True
use_legacy_prediction_loop: False
push_to_hub: False
resume_from_checkpoint: None
hub_model_id: None
hub_strategy: every_save
hub_private_repo: False
hub_always_push: False
gradient_checkpointing: False
gradient_checkpointing_kwargs: None
include_inputs_for_metrics: False
eval_do_concat_batches: True
fp16_backend: True
push_to_hub_model_id: None
push_to_hub_organization: None
mp_parameters:
auto_find_batch_size: False
full_determinism: False
torchdynamo: None
ray_scope: last
ddp_timeout: 1800
torch_compile: False
torch_compile_backend: None
torch_compile_mode: None
dispatch_batches: None
split_batches: None
include_tokens_per_second: False
include_num_input_tokens_seen: False
neftune_noise_alpha: None
optim_target_modules: None
batch_eval_metrics: False
eval_on_start: False
eval_use_gather_object: False
batch_sampler: no_duplicates
multi_dataset_batch_sampler: proportional

Training Logs

Epoch	Step	Training Loss	loss	m3-dev_cosine_map@100
0.7722	500	1.1966	-	-
1.0008	648	-	0.8832	0.4814
1.5436	1000	0.8492	-	-
2.0008	1296	-	0.8582	0.4855
2.3151	1500	0.6805	-	-
2.9961	1941	-	0.8607	0.4914

The bold row denotes the saved checkpoint.

Framework Versions

Python: 3.10.12
Sentence Transformers: 3.0.1
Transformers: 4.43.4
PyTorch: 2.3.1+cu121
Accelerate: 0.32.1
Datasets: 2.19.1
Tokenizers: 0.19.1

Citation

BibTeX

Sentence Transformers

@inproceedings{reimers-2019-sentence-bert,
    title = "Sentence-BERT: Sentence Embeddings using Siamese BERT-Networks",
    author = "Reimers, Nils and Gurevych, Iryna",
    booktitle = "Proceedings of the 2019 Conference on Empirical Methods in Natural Language Processing",
    month = "11",
    year = "2019",
    publisher = "Association for Computational Linguistics",
    url = "https://arxiv.org/abs/1908.10084",
}

MultipleNegativesRankingLoss

@misc{henderson2017efficient,
    title={Efficient Natural Language Response Suggestion for Smart Reply}, 
    author={Matthew Henderson and Rami Al-Rfou and Brian Strope and Yun-hsuan Sung and Laszlo Lukacs and Ruiqi Guo and Sanjiv Kumar and Balint Miklos and Ray Kurzweil},
    year={2017},
    eprint={1705.00652},
    archivePrefix={arXiv},
    primaryClass={cs.CL}
}