🌊 Llamarine - Maritime Navigation Model

Llamarine is a specialized large language model fine-tuned for maritime navigation and seamanship. This is a merged version combining the base Llama-3.1-70B model with maritime-specific LoRA adapters.

🚢 Model Details

Base Model: meta-llama/Llama-3.1-70B
Specialization: Maritime navigation, seamanship, and nautical operations
Model Type: Merged (base + LoRA adapters)
Model Size: ~70.6B parameters
Precision: bfloat16
Context Length: 128k tokens

⚓ Maritime Capabilities

This model excels in:

🧭 Navigation & Piloting

Celestial navigation principles
GPS and electronic navigation
Dead reckoning and position fixing
Chart reading and interpretation
Compass navigation and deviation
Tide and current calculations

🛥️ Ship Operations

Anchoring procedures and techniques
Docking and undocking maneuvers
Ship handling in various conditions
Cargo operations and stability
Emergency procedures

📡 Maritime Communications

Radio protocols and procedures
Distress and safety communications
Port communications
International signal codes

⚖️ Maritime Law & Regulations

International collision regulations (COLREGS)
Maritime traffic separation schemes
Port state control requirements
International maritime conventions

🌊 Weather & Oceanography

Weather routing and planning
Ocean currents and their effects
Storm avoidance techniques
Barometric pressure interpretation

🚀 Usage

Using Transformers

from transformers import AutoTokenizer, AutoModelForCausalLM
import torch

# Load model and tokenizer
tokenizer = AutoTokenizer.from_pretrained("pentagoniac/llamarine")
model = AutoModelForCausalLM.from_pretrained(
    "pentagoniac/llamarine",
    torch_dtype=torch.bfloat16,
    device_map="auto"
)

# Generate response
prompt = "What is dead reckoning navigation?"
inputs = tokenizer(prompt, return_tensors="pt")
outputs = model.generate(
    **inputs,
    max_new_tokens=200,
    temperature=0.7,
    top_p=0.9,
    do_sample=True
)
response = tokenizer.decode(outputs[0], skip_special_tokens=True)
print(response)

Using vLLM (Recommended for Production)

from vllm import LLM, SamplingParams

# Initialize model
llm = LLM(
    model="pentagoniac/llamarine",
    tensor_parallel_size=2,  # Adjust based on your GPU setup
    dtype="bfloat16",
    gpu_memory_utilization=0.95,  # Use 95% of GPU memory
    max_model_len=8192  # Large context length for extended conversations
)

# Configure sampling
sampling_params = SamplingParams(
    temperature=0.7,
    top_p=0.9,
    max_tokens=2000
)

# Generate response
prompt = "How do you anchor a ship in rough weather?"
outputs = llm.generate([prompt], sampling_params)
print(outputs[0].outputs[0].text)

📊 Performance

Response Speed: 18-20 tokens/second (vLLM on 2x A100)
Load Time: ~4 minutes (first load from Hugging Face)
Memory Usage: ~65GB per GPU (tensor parallel)
Context Length: 128k tokens (configurable, tested with 120k)
Maritime Accuracy: Specialized knowledge in nautical operations
Safety Focus: Emphasizes safe maritime practices

💡 Example Prompts

Navigation Questions

"What is celestial navigation?"
"How do you plot a course using GPS?"
"Explain magnetic compass deviation and variation"
"What are the principles of dead reckoning?"

Ship Operations

"What are the steps for anchoring in emergency conditions?"
"How do you perform a man overboard maneuver?"
"What is the proper procedure for docking in strong winds?"
"How do you calculate cargo stability?"

Safety & Regulations

"What are the COLREGS rules for overtaking?"
"How do you signal distress at sea?"
"What are the requirements for crossing traffic separation schemes?"
"What should you do if you encounter a vessel not under command?"

⚠️ Important Notes

Specialized Domain: This model is optimized for maritime topics and may not perform as well on general tasks
Safety Critical: Always verify navigation and safety information with official sources
Professional Use: Intended for maritime professionals and educational purposes
Real-time Operations: Not a substitute for official navigation equipment or procedures
Memory Requirements: Tested with 120k context on 2x A100 GPUs; reduce max_model_len if you have memory constraints

🔧 Hardware Requirements

Minimum Requirements

RAM: 80GB+ system RAM
VRAM: 80GB+ GPU memory (A100 recommended)
Storage: 200GB+ available space

Recommended Setup

GPUs: 2x NVIDIA A100 (80GB each)
RAM: 128GB+ system RAM
Storage: NVMe SSD for optimal loading speed

📚 Training Data

This model was fine-tuned on maritime navigation data including:

Navigation textbooks and manuals
Maritime regulations and procedures
Ship handling guides
Weather routing resources
Emergency response protocols

🤝 Contributing

This model is part of the Llamarine project aimed at advancing AI assistance in maritime operations. For questions or contributions, please reach out through the Hugging Face community.

📄 License

This model inherits the Llama 2 license from the base model. Please review the license terms before commercial use.

🌊 Fair Winds and Following Seas

"The sea, once it casts its spell, holds one in its net of wonder forever." - Jacques Cousteau

pentagoniac
/

llamarine