Finetune Problem 微调的各种问题 #270
Replies: 36 comments 76 replies
-
|
您好！很高兴发现了CogLVM 关于微调有一下问题： |
Beta Was this translation helpful? Give feedback.
-
|
这个问题请回答下，谢谢 |
Beta Was this translation helpful? Give feedback.
-
|
确实，Option 3, finetune CogAgent/CogVLM所给的captcha数据集 |
Beta Was this translation helpful? Give feedback.
-
|
这个demo在dataset.py中把图片文件的文件名作为caption，对应简单的一问一答。我也想搞明白多轮问答的数据处理应该怎样处理喂给模型。谢谢！ |
Beta Was this translation helpful? Give feedback.
-
|
seems like it is partially answered here: (closed issues里包含了这个贴里的一些问题) |
Beta Was this translation helpful? Give feedback.
-
|
我也遇到了这个问题，自定义数据集images中的图片名称对应lables中的json名称，但是该如何喂给模型，还在研究中 |
Beta Was this translation helpful? Give feedback.
-
|
hi,我在按照示例来微调
我自己的参数是(_name_or_path='/mntnlp/common_base_model/cogvqa/cogagent', architectures=['CogAgentForCausalLM'], attention_dropout=0.1, auto_map={'AutoConfig': 'configuration_cogagent.CogAgentConfig', 'AutoModelForCausalLM': 'modeling_cogagent.CogAgentForCausalLM'}, batch_from_same_dataset=False, batch_size=4, bf16=False, block_size=10000, bos_token_id=1, checkpoint_activations=False, checkpoint_num_layers=1, checkpoint_skip_layers=0, cross_compute_hidden_size=1024, cross_hidden_size=1024, cross_image_pix=1120, cross_image_size=1120, cuda=True, deepscale=False, deepscale_config=None, deepspeed=True, deepspeed_activation_checkpointing=False, deepspeed_config={'train_micro_batch_size_per_gpu': 4, 'gradient_accumulation_steps': 1, 'gradient_clipping': 0.1, 'fp16': {'enabled': False, 'loss_scale': 0, 'loss_scale_window': 200, 'hysteresis': 2, 'min_loss_scale': 0.01}, 'bf16': {'enabled': False}, 'optimizer': {'type': 'AdamW', 'params': {'lr': 0.0001, 'weight_decay': 0.01}}}, deepspeed_mpi=False, device=0, distributed_backend='nccl', drop_path=0.0, eos_token_id=2, epochs=None, eva_args={'model_parallel_size': 1}, eval_batch_size=None, eval_interval=None, eval_iters=100, exit_interval=None, experiment_name='finetune-/mntnlp/common_base_model/cogvqa', fp16=False, from_pretrained='/mntnlp/common_base_model/cogvqa', gradient_accumulation_steps=1, hidden_act='silu', hidden_dropout=0.1, hidden_size=4096, hidden_size_per_attention_head=None, ignore_pad_token_for_loss=True, image_length=256, initializer_range=0.02, inner_hidden_size=None, input_source='interactive', intermediate_size=11008, iterable_dataset=False, layer_range=None, layernorm_epsilon=1e-05, layernorm_order='pre', length_penalty=0.0, load=None, local_rank=0, local_tokenizer='/mntnlp/common_base_model/vicuna_v1.5_7b', log_interval=50, lora_rank=50, lr=0.0001, lr_decay_iters=None, lr_decay_ratio=0.1, lr_decay_style='cosine', make_vocab_size_divisible_by=128, master_ip='127.0.0.1', master_port='16666', max_inference_batch_size=12, max_length=400, max_position_embeddings=2048, max_sequence_length=512, min_tgt_length=0, mode='finetune', model_parallel_size=1, no_load_rng=False, no_repeat_ngram_size=0, no_save_rng=False, num_attention_heads=32, num_beams=1, num_hidden_layers=32, num_layers=6, num_multi_query_heads=0, num_workers=1, out_seq_length=256, output_path='./samples', pad_token_id=0, pre_seq_len=8, prefetch_factor=4, rank=0, resume_dataloader=True, rms_norm_eps=1e-05, save=None, save_args=False, save_interval=5000, seed=1234, skip_init=False, split='1000,1,1', strict_eval=False, summary_dir='', temperature=1.0, template_version='chat', test_data=None, tie_word_embeddings=False, tokenizer_type='fake', top_k=0, top_p=0.0, torch_dtype='bfloat16', train_data=['./archive_split/train'], train_data_weights=None, train_iters=2000, transformers_version='4.36.0.dev0', use_cache=True, use_gpu_initialization=False, use_lora=True, use_ptuning=False, use_qlora=False, valid_data=['./archive_split/valid'], version='chat', vision_config={'dropout_prob': 0.0, 'hidden_act': 'gelu', 'hidden_size': 1792, 'image_size': 224, 'in_channels': 3, 'intermediate_size': 15360, 'layer_norm_eps': 1e-06, 'num_heads': 16, 'num_hidden_layers': 63, 'num_positions': 257, 'patch_size': 14}, vit_checkpoint_activations=False, vocab_size=32000, warmup=0.02, weight_decay=0.01, with_id=False, world_size=1, zero_stage=0) 这个inner_hidden_size默认怎么设置呢，感激 |
Beta Was this translation helpful? Give feedback.
-
|
enable = ["encoder", "cross_attention", "linear_proj", 'mlp.vision', 'rotary.vision', 'eoi', 'boi', 'vit'] |
Beta Was this translation helpful? Give feedback.
-
|
同问，麻烦回复一下 |
Beta Was this translation helpful? Give feedback.
-
|
This can be somewhat a duplicated question, So here are my questions:
|
Beta Was this translation helpful? Give feedback.
-
|
Hmm with default setting, after lora there are still 11.6b parameters, changing the rank to 1 only decreased it to 11.5b. So you guys didn't apply it on some weights right. I would appreciate it a lot if you guys can give me some advise for modify the lora range. |
Beta Was this translation helpful? Give feedback.
-
|
我在8*3090上试图精调CogAgent模型，设置MP_SIZE=4，内存（500G）在模型加载阶段就会爆掉。请问有什么办法能够减少这部分内存占用吗？ |
Beta Was this translation helpful? Give feedback.
-
|
我发现他们lora设置的很奇怪，按lora的paper应该是lora apply在所有attention的layer上然后trainable parameter设置成只有lora出来的心得delta w。但他们把lora的parameter加到了trainable parameter里。我把这个改了加上deepspeed model parameters之外的video memory损耗就相当少了。 parameters 他们用了bfloat16 大概要35g |
Beta Was this translation helpful? Give feedback.
-
|
这个repo他们还没implement batch inference.. |
Beta Was this translation helpful? Give feedback.
-
|
感谢解答！麻烦问下具体应该在哪里修改呢？我之前做小模型2333刚刚接触LLM的Lora精调之类的…… |
Beta Was this translation helpful? Give feedback.
-
|
遇到了跟 #268 中一样的问题。除了MP_SIZE和NUM_GPUS_PER_WORKER外没有修改其他参数，基于官方SAT拖的权重进行精调，在 |
Beta Was this translation helpful? Give feedback.
-
|
这个感觉是你输入没有padding? |
Beta Was this translation helpful? Give feedback.
-
|
这个是loading checkpoint后，处理lora层的时候报的错，应该没关系？稍微复原了一下Traceback是这样的： 这个64会随着MP_SIZE的不同而变化。在此之前的logline是这样的： 顺带一提cogagent的logline从building FineTuneTrainCogAgentModel model之后就开始重复……CogVLM没有这个问题 |
Beta Was this translation helpful? Give feedback.
-
|
调试了一下还是没搞懂为什么会出错，RowParallelLinear替换在前面是正常的。但是唯独此处，在 lora2.py#L94 之前传进去[4096,256]的参数，出来得到的实例就变成[4096,64]了 |
Beta Was this translation helpful? Give feedback.
-
|
我也遇到了这个问题 |
Beta Was this translation helpful? Give feedback.
-
|
想问一下，微调能放开backend的各层参数来微调吗？如果能的话，具体怎么做？ |
Beta Was this translation helpful? Give feedback.
-
|
我按照demo的实例，下载好图片并设置好路径之后执行 bash finetune_cogvlm_lora.sh，得到下面的错误，想知道是什么原因
|
Beta Was this translation helpful? Give feedback.
-
|
sat的bug，在最新版本中修复了，先uninstall掉原来的sat，然后按照以下方式安装新的sat： |
Beta Was this translation helpful? Give feedback.
-
|
这个ERROR的地方过了，谢谢 |
Beta Was this translation helpful? Give feedback.
-
|
Hello! |
Beta Was this translation helpful? Give feedback.
-
|
请问现在有没有对hf model进行Lora或者qlora的代码呢？为什么用提供的finetune script 无法微调本地下载的hf model呢？ |
Beta Was this translation helpful? Give feedback.
-
|
Good luck |
Beta Was this translation helpful? Give feedback.
-
|
hf的微调代码由于开发组较忙一直没有时间做之后会放出一个版本 |
Beta Was this translation helpful? Give feedback.
-
|
我要是写好了是不是可以给你们提一个MR之类的？ |
Beta Was this translation helpful? Give feedback.
-
|
可以，我fork的分支已经写了，欢迎提出PR，可以参考我的失败案例 |
Beta Was this translation helpful? Give feedback.
-
|
请问一下现在的eval和finetune脚本是都仅支持sat，暂时没有提供hf的版本嘛？ |
Beta Was this translation helpful? Give feedback.
-
|
CogAgent的pretrain数据和qa格式的微调数据有计划开源吗? |
Beta Was this translation helpful? Give feedback.
-
|
暂时没有 |
Beta Was this translation helpful? Give feedback.
-
|
bash finetune_demo/finetune_cogvlm_lora.sh |
Beta Was this translation helpful? Give feedback.
-
|
看着像没安装完 |
Beta Was this translation helpful? Give feedback.
-
|
我不咋会，这个按照官方来的都没成功，能帮帮我不，感谢 |
Beta Was this translation helpful? Give feedback.
-
|
我也不是非常懂。最好把错误全文完整放上来。其它的网站能搜到这个错误，不知道会不会有帮助。 |
Beta Was this translation helpful? Give feedback.
-
|
能加个联系方式帮我看看不。球球了 |
Beta Was this translation helpful? Give feedback.
-
|
错误老长了，而且是我修改了好几个能解决的了，然后出现的，找了很久没找到，估计是我开始就有步骤不对造成的。 |
Beta Was this translation helpful? Give feedback.
-
|
finetune cogvlm最后一步save出来的文件大小是基底模型文件的两倍，有60+G，是因为float精度吗？请问怎样保存成比较小的文件可直接用于inference？ the final saved file in finetune cogvlm is almost twice as big as the base model file, 60+G, is it float precision? How to save to smaller file that can be used for inferencing? |
Beta Was this translation helpful? Give feedback.
-
|
可以手动把.pt里的除了'module'以外的状态删掉。 import torch
data = torch.load('mp_rank_00.pt')
for k in list(data.keys()):
if k != 'module':
del data[k]
torch.save(data, 'mp_rank_00_new.pt') |
Beta Was this translation helpful? Give feedback.
-
|
对于cogvlm微调，训练时采用半精度训练，模型保存时，也会保存成半精度的；但是通过对比开放出来的SAT/cogvlm-chat-v1.1/mp_rank_00_model_states.pt，与自己微调训练出来的mp_rank_00_model_states.pt，中的字段 len(origin_model["frozen_param_fragments"]) = 0
len(finetune_model["frozen_param_fragments"]) = 1156
nums = [torch.prod(torch.tensor(list(v.shape))) for k, v in finetune_model["frozen_param_fragments"].items()]
tensor(14186905088)微调训练后，保存的模型中的 |
Beta Was this translation helpful? Give feedback.
-
|
追踪到了sat中的代码，发现把 deepspeed=None，mode=‘inference’，保存出来的文件是较小的。和merge_model.py中的设置一致。（merge_model.py并没有merge，只是读取保存的文件再转成inferrence版本。好像没有必要存在） |
Beta Was this translation helpful? Give feedback.
-
|
merge_model.py是用来合并模型并行的，需要用torchrun多卡启动。如果你训练没用模型并行那就不需要了。 |
Beta Was this translation helpful? Give feedback.
-
|
明白了，谢谢解释 |
Beta Was this translation helpful? Give feedback.
-
训练过程中模型阶段性保存，可以将这部分去掉？如何去掉？ |
Beta Was this translation helpful? Give feedback.
-
|
这个不是指的merge_model过程中，而是在training_main过程中，我按照一定save_iters，来保存中间模型，以期后续具体测试选择一个表现最好的，中间过程模型保存时，我查看了下中间保存的模型，同样会将frozen_param_fragments权重进行保存，从而使得占用的存储翻倍； model, args = FineTuneTrainCogVLMModel.from_pretrained(args.from_pretrained, args, overwrite_args={'model_parallel_size': args.model_parallel_size} if args.model_parallel_size != 1 else {})
if args.use_ptuning:
model.add_mixin("ptuning", PTuningV2Mixin(args.num_layers, args.hidden_size // args.num_attention_heads, args.num_attention_heads, args.pre_seq_len))
if args.use_lora:
model.add_mixin("lora", LoraMixin(args.num_layers, args.lora_rank, layer_range=args.layer_range), reinit=True)
model.get_mixin("eva").vit_model.add_mixin("lora", LoraMixin(args.eva_args['num_layers'], args.lora_rank, layer_range=args.layer_range), reinit=True)
elif args.use_qlora:
model.add_mixin("lora", LoraMixin(args.num_layers, args.lora_rank, layer_range=args.layer_range, qlora=True), reinit=True)
if args.use_qlora and torch.cuda.is_available():
model = model.to('cuda')
from utils.utils import llama2_tokenizer
tokenizer = llama2_tokenizer(args.local_tokenizer, signal_type=args.version)
image_processor = get_image_processor(args.eva_args["image_size"][0])
text_processor = llama2_text_processor(tokenizer, args.max_length, args.image_length)
model = training_main(args, model_cls=model, forward_step_function=forward_step, create_dataset_function=partial(create_dataset_function, image_processor, text_processor), collate_fn=data_collator, forward_step_eval=forward_step_eval)
if args.use_lora:
model.get_mixin("lora").merge_lora()
model.get_mixin("eva").vit_model.get_mixin("lora").merge_lora()
args.use_lora = False
args.save = "checkpoints/merged_lora_cogvlm{}".format(args.eva_args["image_size"][0])
from sat.training.model_io import save_checkpoint
save_checkpoint(1, model, None, None, args) |
Beta Was this translation helpful? Give feedback.
-
|
好吧，问问题的人为什么换了……所以你是要解决另一个问题，前一个人想解决的是内存的问题。你想解决的是硬盘的问题…… |
Beta Was this translation helpful? Give feedback.
-
|
嗯，主要想处理training_main过程中的，中间模型保存时包含的frozen_param_fragments这部分，其他，merge_model.py, 以及合并lora权重，都可以自己手动删除， |
Beta Was this translation helpful? Give feedback.
-
|
这个没办法，可以去deepspeed仓库问一下，保存的时候他们目前是默认全保存的： |
Beta Was this translation helpful? Give feedback.
-
|
ok, 看这个api，看起来是可以有参数控制的 def _save_checkpoint(self, save_dir, tag, client_state={}, exclude_frozen_parameters=False):
save_path = self._get_ckpt_name(save_dir, tag)
zero_optimizer_state = self.zero_optimization() or self.bfloat16_enabled()
save_frozen_param = self.zero_optimization_partition_gradients() and not exclude_frozen_parameters
# A hack to save the checkpointing directory. Pipeline parallelism overrides
# module_state_dict() and uses this path to save the model. module_state_dict()
# then instead just returns None. The module_state_dict() implementation in
# PipelineEngine expects the save path to be set in self._curr_ckpt_path.
self._curr_ckpt_path = os.path.join(save_dir, tag)
module = self.module_state_dict(exclude_frozen_parameters=exclude_frozen_parameters)
self._curr_ckpt_path = None
state = dict(module=module,
buffer_names=self._get_buffer_names(),
optimizer=self.optimizer.state_dict() if self.optimizer and not zero_optimizer_state else None,
param_shapes=self._get_zero_param_shapes() if self.optimizer and zero_optimizer_state else None,
frozen_param_shapes=self._get_zero_frozen_param_attributes(self._get_param_shape_func)
if save_frozen_param else None,
shared_params=self._get_shared_params() if self.optimizer and zero_optimizer_state else None,
frozen_param_fragments=self._get_zero_frozen_param_attributes(self._get_param_fragment_func)
if save_frozen_param else None,
lr_scheduler=self.lr_scheduler.state_dict() if self.lr_scheduler is not None else None,
data_sampler=self.training_dataloader.data_sampler.state_dict() if
(self.training_dataloader is not None and self.curriculum_learning_enabled()) else None,
random_ltd=self.random_ltd_scheduler.state_dict() if self.random_ltd_enabled() else None,
sparse_tensor_module_names=self.sparse_tensor_module_names,
skipped_steps=self.skipped_steps,
global_steps=self.global_steps,
global_samples=self.global_samples,
dp_world_size=self.seq_dp_world_size,
mp_world_size=self.mp_world_size,
ds_config=self.config,
ds_version=version)
state.update(client_state) |
Beta Was this translation helpful? Give feedback.
-
|
遇到问题：使用finetune_cogvlm_demo.py 跑几张图，跑了100步，发现loss一直是0，validation pred 文字也一直没有任何变化。 训练参数在原基础上改了batch_size=1，MP_num=1, 其它都没碰。因为vram不够，可训练参数没有包含lora，仅包含vit mlp 和 ptuning。 会是什么问题呢？ |
Beta Was this translation helpful? Give feedback.
-
|
好像loss没有被计算，validation主要看实际输出的文字内容主观判断训练进程。将训练模式从base改成vqa，打印出来每一步的loss和validation pred，训练确实在进行。 |
Beta Was this translation helpful? Give feedback.
-
Beta Was this translation helpful? Give feedback.
-
|
finetune之后保存出来的模型，用来inference，会报错“missing/unexpected key”在model_state_dic里。发现所有模块名称前面都多了个“module”，手动清掉之后就可以正常inference。保存的时候应该如何调整设置才能避免这个问题？比如： Keys only in sd['module']: Keys only in model.state_dict(): 第二个是正确的。 |
Beta Was this translation helpful? Give feedback.
-
|
What are the minimum hardware requirements to finetune CogAgent? I have a cluster of 8xV100 available, are there changes to the script I can make to run this more efficiently? Thanks in advance! |
Beta Was this translation helpful? Give feedback.
-
|
I collect 400G RAM，and set shm=50G. Set MP_SIZE=8 in |
Beta Was this translation helpful? Give feedback.
-
|
我在使用自己的数据 finetune 的时候，遇到两个问题： |
Beta Was this translation helpful? Give feedback.
-
|
1，我改大了，貌似没有问题，可以训练。 |
Beta Was this translation helpful? Give feedback.
-
|
是的，我调大了 max_length 训练没有问题。第二个问题也是 prompt 过长导致的，调大 max_length 即可。 |
Beta Was this translation helpful? Give feedback.
-
|
Whats the correct data format and structure for fine-tuning cogent? Is it a folder with corresponding pairs of .json and .jpg ? Where conversations / captions .json files are formatted like in https://github.com/THUDM/CogVLM/blob/main/dataset.md#dataset-quantity? |
Beta Was this translation helpful? Give feedback.
-
|
微调时候，出现以下错误 |
Beta Was this translation helpful? Give feedback.
-
!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!!! See https://gist.github.com/goldsborough/d466f43e8ffc948ff92de7486c5216d6 |
Beta Was this translation helpful? Give feedback.
-
|
4.8.5 看起来是 CentOS 7 的 gcc，而pytorch 要求更高。建议通过 pytorch 的官方 conda 环境安装pytorch就不会有这样的问题 |
Beta Was this translation helpful? Give feedback.
-
|
+1，我也是这个问题，请问解决了吗 |
Beta Was this translation helpful? Give feedback.
-
|
您好，我在尝试微调模型后用evaluate_cogvlm.sh推理了，但是发现模型的回答不是正常文字。同时也使用了cogvlm-chat-v1.1原版模型（只更改了model_config.json文件里的nums_layers: 分别为2/4），输出的也不是正常文字。 |
Beta Was this translation helpful? Give feedback.
-
|
请问怎么基于Lora微调的模型再进行Lora微调。我已经基于base模型lora微调了一个模型并保存了CKPT，我想加载这个CKPT后并联上Lora层，再在其他数据集上做微调，请问如何配置？ |
Beta Was this translation helpful? Give feedback.
-
|
运行微调sh文件的时候出现 |
Beta Was this translation helpful? Give feedback.
-
|
不要用 pip 安装 torch, 用 conda 安装二进制兼容会更好 |
Beta Was this translation helpful? Give feedback.
-
|
新建了个环境，conda 安装了torch2.1.1还是不太行..... |
Beta Was this translation helpful? Give feedback.
-
|
问题应该解决了，是cuda版本的问题，切到跟torch版本一样的cuda就解决了，但是报错显存不够。。。。。 |
Beta Was this translation helpful? Give feedback.
-
|
8卡A100运行finetune_cogagent_lora.sh爆显存.... |
Beta Was this translation helpful? Give feedback.
-
|
调成1也不行.... |
Beta Was this translation helpful? Give feedback.
-
|
NUM_GPUS_PER_WORKER=8，MP_SIZE=8 应该是可以的，注意调整 batch_size 的大小，另外内存也要保证够大 |
Beta Was this translation helpful? Give feedback.
-
|
NUM_GPUS_PER_WORKER=4，MP_SIZE=4 在 4 * A100 80G， batch_size 试过4，2都不行，最后只能调成1跑起来了 |
Beta Was this translation helpful? Give feedback.
-
|
输入文件的分辨率会对VRAM使用率有影响么？ |
Beta Was this translation helpful? Give feedback.
-
|
@ShChen233 我的 cuda 环境是11.8, 如果通过原始的 pip install 安装 requirements 的话，执行的时候会有如下告警 字面上看起来版本不匹配会影响到内存使用的效率，降级XFORMERS到cuda11.8的版本就可以解决了，不过这里得小心它会安装 2.1.0 的torch, 要在 xformer装完后再用conda 把torch装回2.1.2 如果直接用官方pytorch 2.1.2的 cuda12.1版本应该就不会有这么多问题了。 |
Beta Was this translation helpful? Give feedback.
-
|
想问一下有人试过 ，quant4 量化微调CogAgent嘛？我报维度错误：File "/root/miniconda3/envs/CogVLM/lib/python3.10/site-packages/sat/model/finetune/lora2.py", line 97, in init |
Beta Was this translation helpful? Give feedback.
-
|
能否说明一下这些参数具体是指哪些模块：enable = ["encoder", "cross_attention", "linear_proj", 'mlp.vision', 'rotary.vision', 'eoi', 'boi', 'vit']，如果要冻结是不是仅仅在这里设置就可以了 |
Beta Was this translation helpful? Give feedback.
-
|
我微调的时候，直接置空了，enable=[]；我只微调transformers的32层 |
Beta Was this translation helpful? Give feedback.
-
|
微调如果要从没有merge过的checkpoint应该如何继续呢？ |
Beta Was this translation helpful? Give feedback.
-
|
我试了，可以在推理的时候所有的 from pretrain里的AutoModel类改为 FinetuneTestModel类 |
Beta Was this translation helpful? Give feedback.
-
|
不是指用 checkpoint 推理，是指意外中断后重新提交作业如何从还没有merged过的checkpoint 继续 |
Beta Was this translation helpful? Give feedback.
-
|
我看了几个 sat 的示例尝试用 ValueError: could not find the metadata file checkpoints/finetune-cogagent-vqa-04-10-13-37/1200/latest, please check --load
raise ValueError('could not find the metadata file {}, please check --load'.format(
raise ValueError('could not find the metadata file {}, please check --load'.format(
ValueError: ValueErrorcould not find the metadata file checkpoints/finetune-cogagent-vqa-04-10-13-37/1200/latest, please check --load:
could not find the metadata file checkpoints/finetune-cogagent-vqa-04-10-13-37/1200/latest, please check --load
raise ValueError('could not find the metadata file {}, please check --load'.format(
ValueError: could not find the metadata file checkpoints/finetune-cogagent-vqa-04-10-13-37/1200/latest, please check --load |
Beta Was this translation helpful? Give feedback.
-
|
请问多轮对话如何把多个问答拼接起来？如何修改dataset.py呢？
|
Beta Was this translation helpful? Give feedback.
-
|
这个问题需要自己修改CAPTCHA，然后修改process_text内部的逻辑，自己实现。 |
Beta Was this translation helpful? Give feedback.
-
|
请问 finetune cogagent _demo 代码中使用的data_collator 返回的信息如下： 但是我看cogagent模型的forward 方法中接受的参数并不是这些，好奇中间还有哪里做了什么处理吗？
|
Beta Was this translation helpful? Give feedback.
-
|
请问如何把4卡并行lora微调出来的模型合并成一个模型。 我加载了开源的cogvlm-base-490模型，使用MP_SIZE=4做了lora微调，保存了一个CKPT，包含4个文件（mp_rank_00_model_states.pt到mp_rank_03_model_states.pt ）。请问我如何把模型合并成MP_SIZE=1的模型并存储到一个文件呢。谢谢 |
Beta Was this translation helpful? Give feedback.
and others
-
Please articulate any questions about model fine-tuning here; these questions will be answered by community members and officials in their spare time.
在这里阐述任何关于模型微调的问题，这些问题将由社区成员和官方在空闲的时间进行回答
Beta Was this translation helpful? Give feedback.
All reactions