LLMs/AlpacaGPT4-LoRA-7B-elina

This is LoRA checkpoint fine-tuned with the following CLI. The fine-tuning process is logged in W&B dashboard. I have used DGX workstation with 8 x A100(40G).

python finetune.py \
    --base_model='elinas/llama-7b-hf-transformers-4.29' \
    --data_path='alpaca_data_gpt4.json' \
    --num_epochs=10 \
    --cutoff_len=1024 \
    --group_by_length \
    --output_dir='./lora-alpacagpt4-7b-elinas' \
    --lora_target_modules='[q_proj,k_proj,v_proj,o_proj]' \
    --lora_r=16 \
    --lora_alpha=32 \
    --batch_size=1024 \
    --micro_batch_size=40

This LoRA checkpoint is recommended to be used with transformers >= 4.29 which should be installed with the following command currently(4/30/2023).

pip install git+https://github.com/huggingface/transformers.git

Please find out the example usage and results in the accompanied notebook. For the example outputs are listed below as well.

1. Instruction: Compose an engaging travel blog post about a recent trip to Hawaii, highlighting cultural experiences and must-see attractions.

Greetings from the tropical paradise of Maui! Let me take you on an adventure through one of the world's most enchanting destinations - Hawaii Island. My name is Jenny Chupeco and I am a travel blogger who loves sharing my journeys with like minded people around the globe. This beautiful island has something for everyone in store, whether it be surfing, hiking or simply lounging at the beach – there’s no lack of activities here. Today, let us explore some of its rich culture, cuisine and history that makes this place so unique and memorable.

Hawaiians are well known for their warm hospitality and traditions, often referred to as “aloha spirit”. It can be seen everywhere in small gestures such as greeting someone by saying “Aloha” which translates into “hello” but means much more than just “hi”, inviting them to relax and enjoy themselves. The local population takes great pride in preserving their customs and traditions throughout generations.

One way visitors experience aloha is during traditional dance performances called “hula”. Hulas were originally created many

2. Instruction: Can you help me write a formal email to a potential business partner proposing a joint venture?

Dear [Prospective Business Partner],

Thank you for your interest in our proposed partnership. We at Company X have been contemplating the possibility of entering into a Joint Venture with another organization, and we believe that our respective strengths could make us formidable allies on any project or opportunity that comes up. Our core competencies include expertise in technology development, operations management, market research, and strategic planning, all areas which would greatly benefit from your experience as an innovator in manufacturing, supply chain logistics, and product design. By joining forces, we can leverage each other's resources to achieve mutual growth and success.

As such, we are seeking your input regarding specific details about the nature of this potential partnership including goals, objectives, timelines, roles and responsibilities, risk-sharing arrangements, funding sources, governance structures, etc., so that we may better assess whether there is alignment between our interests before making further plans towards establishing a strong working relationship. Thank you again for considering our proposal; if anything further is needed, please do not hesitate to let us know.

3. Instruction: What factors would you consider when designing an inclusive and accessible public transportation system?

1. Accessibility for all modes of transport - including walking, biking, driving, buses, trains etc., ensuring that everyone can reach the destination with ease.
2. Inclusiveness - providing equal access to people with disabilities or other limitations. This could include ramps on bus stops or lifts at train stations, braille signs in subway tunnels, audible announcements at busy transit hubs, handicapped parking spots near entrances.
3. Communications - providing clear and reliable information about route schedules, delays, changes and emergencies to users across different channels such as audio alert systems, text message updates, digital kiosks or customer service centers.
4. Safety – using surveillance cameras, anti-graffiti paint, CCTV security systems to reduce instances of crime, harassment or accidents within the transit environment.

4. Instruction: What are some potential implications of using a single-use plastic bottle versus a reusable bottle on both the environment and human health?

Using a single use plastics bottles has several potential impacts in regards to environmental concerns as well as human health. A few examples include:

1. Single Use Plastic Bottles create litter, clogging our rivers, oceans, landfills and polluting habitats for animals such as sea turtles who mistake them for jellyfish or other food sources that have led to their decline in populations due to ingestion. It also creates waste which is not biodegradable and poses an extended threat to wildlife by providing breeding grounds for mosquitoes etc., contributing to global warming through greenhouse gas emissions from incineration and degrades water quality causing eutrophication leading to harmful algal blooms (HAB).

2. Reusing a metal stainless steel can significantly reduce these negative effects compared with disposing it after just one use. This will prevent further contamination and waste creation. Moreover, reducing the need for new raw materials required for manufacturing more single-use products saves energy, and reduces carbon dioxide (CO2), methane (CH4), and nitrous oxides (N2O) –