{"payload":{"feedbackUrl":"https://github.com/orgs/community/discussions/53140","repo":{"id":505467900,"defaultBranch":"main","name":"V1T","ownerLogin":"bryanlimy","currentUserCanPush":false,"isFork":false,"isEmpty":false,"createdAt":"2022-06-20T14:08:20.000Z","ownerAvatar":"https://avatars.githubusercontent.com/u/9648242?v=4","public":true,"private":false,"isOrgOwned":false},"refInfo":{"name":"","listCacheKey":"v0:1692295532.0","currentOid":""},"activityList":{"items":[{"before":"367aedf5bd491d38aeede644ba031bd872116b71","after":null,"ref":"refs/heads/wandb_update","pushedAt":"2023-08-17T18:05:32.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"}},{"before":"a306a982df3d617bc0a65c601d9d9a5816c5c022","after":null,"ref":"refs/heads/generalization_fix","pushedAt":"2023-08-17T18:03:31.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"}},{"before":"3cde85c922216fac85710fe138c9716e797cb4f0","after":"ba1ddc3f7b13c35b9e649fe2b6c8f0b4409a0947","ref":"refs/heads/main","pushedAt":"2023-08-17T18:03:28.000Z","pushType":"pr_merge","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"Estimate aRFs, test sample efficiency and transfer learning performance (#24)\n\n* wandb init in utils\r\n\r\n* update ensemble code\r\n\r\n* convert mouse ids from int to str\r\n\r\n* convert mouse ids from int to str\r\n\r\n* code to load pretrained core and freeze it\r\n\r\n* script to convert yaml to csv\r\n\r\n* --limit_data to limit to number of training samples for each animal\r\n\r\n* --limit_data to limit to number of training samples for each animal\r\n\r\n* mouse naming\r\n\r\n* update mouse naming\r\n\r\n* update\r\n\r\n* add --gray_scale flag to convert colored image to gray-scale\r\n\r\n* print statements\r\n\r\n* freeze logic\r\n\r\n* print statement\r\n\r\n* update notebook\r\n\r\n* compute abs correlation between dilation and standard deviation of attention map in x and y axes\r\n\r\n* use pytorch 2.0\r\n\r\n* update limit data\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update type\r\n\r\n* supress torchinfo user warning\r\n\r\n* plot limit data\r\n\r\n* comptue location maps\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* plots for RFs\r\n\r\n* update plots\r\n\r\n* update\r\n\r\n* update plot Figure number\r\n\r\n* update\r\n\r\n* update\r\n\r\n* remove fit gabor code\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update plots\r\n\r\n* update\r\n\r\n* update plot_samples code. update requirements and add lightning\r\n\r\n* change int to str for dataloaders\r\n\r\n* set cuda manual_seed\r\n\r\n* updateg\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* limit_data use numpy random generator\r\n\r\n* update\r\n\r\n* set torch.backend.cudnn.benchmark to False with --determinisitc\r\n\r\n* use match-case instead of if-else in Image2Patches\r\n\r\n* clean behavior-mlp implementation\r\n\r\n* update training loop to fix OOM in gradient accumulation\r\n\r\n* store predictions and targets in lists and compute metrics after finish micro batches\r\n\r\n* fix typo\r\n\r\n* model.regularizer() always return tensor\r\n\r\n* revert returning tensor in model.regularizer()\r\n\r\n* model.regularizer() sum a list of loss\r\n\r\n* always set torch.backends.cudnn.benchmark\r\n\r\n* always set torch.backends.cudnn.benchmark\r\n\r\n* load result of metric calculation to CPU\r\n\r\n* del batch, targets and predictions at the end of train_step\r\n\r\n* del micro_batch after each backward call\r\n\r\n* call detach().cpu() for all variables in train_step\r\n\r\n* del micro_batch, y_true and y_pred at the end of micro_batch\r\n\r\n* revert to 54acdd7 and clean code\r\n\r\n* set_to_none=True in optimizer.zero_grad\r\n\r\n* add torch.compile\r\n\r\n* standalone ScaledDotProductAttention module with PyTorch FlashAttention implementation, see --attention_mode flag\r\n\r\n* reset to 40bcbf1. use checkpoint in Attention forward function instead of Transformer forward.\r\n\r\n* reset to 40bcbf1. use checkpoint in Attention forward function instead of Transformer forward.\r\n\r\n* turn off set_to_none in optimizer.zero_grad\r\n\r\n* update\r\n\r\n* rename estimate_receptive_fields file\r\n\r\n* update estimate_receptive_fields\r\n\r\n* update\r\n\r\n* update attention visualization and center of mass code\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update readme\r\n\r\n* update limit_data plot with p-value\r\n\r\n* update\r\n\r\n* update limit_data plot\r\n\r\n* update limit_data plot\r\n\r\n* update demo code. publish Recorder and attention rollout map extraction\r\n\r\n* update center of mass\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* extract attention rollout maps within the loop to avoid OOM\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* use pytorch attention rollout maps\r\n\r\n* use pytorch attention rollout maps\r\n\r\n* general extract_attention_maps function in attention_rollout.py\r\n\r\n* update\r\n\r\n* rename files\r\n\r\n* update\r\n\r\n* try F.scaled_dot_product_attention layer\r\n\r\n* revert\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update estimate aRFs code\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update plotting code\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* plot for main figure\r\n\r\n* update\r\n\r\n* add --core_lr argparse and delete --core_lr_scale\r\n\r\n* update\r\n\r\n* update\r\n\r\n* compute aRF degree\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update validation_step\r\n\r\n* update\r\n\r\n* update validation_step\r\n\r\n* update\r\n\r\n* replace --compile with --backend option\r\n\r\n* change init wandb position\r\n\r\n* train_step validation_step cast to cpu at the end\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* optimizer zero_grad set_to_none\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* also compute normalized correlation\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* einops torch.compile update\r\n\r\n* update\r\n\r\n* update\r\n\r\n* clean vit.py file\r\n\r\n* add Dual PatchNorm ViT\r\n\r\n* update\r\n\r\n* update core input arguments\r\n\r\n* update ensemble file\r\n\r\n* update limit_data plot to add ViT\r\n\r\n* update\r\n\r\n* update README","shortMessageHtmlLink":"Estimate aRFs, test sample efficiency and transfer learning performan…"}},{"before":"cebb4e73026773e954be9c5825256d800161bc00","after":"a306a982df3d617bc0a65c601d9d9a5816c5c022","ref":"refs/heads/generalization_fix","pushedAt":"2023-08-17T17:53:21.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"update README","shortMessageHtmlLink":"update README"}},{"before":"9b28ba795a61260dda38f2d51ebbc874bdcbbd74","after":"473acde1e252e2b20b5a07dd5d7f7fff348389e8","ref":"refs/heads/pretrain_v1t","pushedAt":"2023-08-16T18:19:35.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"remove target shape in ViT","shortMessageHtmlLink":"remove target shape in ViT"}},{"before":"b269989896735c53ef168859577749fdacba0b31","after":"9b28ba795a61260dda38f2d51ebbc874bdcbbd74","ref":"refs/heads/pretrain_v1t","pushedAt":"2023-08-16T18:19:03.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"q*scale @ k.T instead of (q @ k.T) * scale","shortMessageHtmlLink":"q*scale @ k.T instead of (q @ k.T) * scale"}},{"before":"afec50e5501c21cc0204ba3907c9f70afec5683f","after":"b269989896735c53ef168859577749fdacba0b31","ref":"refs/heads/pretrain_v1t","pushedAt":"2023-08-11T09:19:41.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"v1t core force output shape","shortMessageHtmlLink":"v1t core force output shape"}},{"before":"ebabebb55c9909e847edadf4813dec807a87d63d","after":"afec50e5501c21cc0204ba3907c9f70afec5683f","ref":"refs/heads/pretrain_v1t","pushedAt":"2023-08-08T09:51:04.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"update","shortMessageHtmlLink":"update"}},{"before":"3d2739b98fb1dc5419d39efd114ab61cbecdfd26","after":"ebabebb55c9909e847edadf4813dec807a87d63d","ref":"refs/heads/pretrain_v1t","pushedAt":"2023-08-08T09:38:14.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"udpate","shortMessageHtmlLink":"udpate"}},{"before":"cebb4e73026773e954be9c5825256d800161bc00","after":"3d2739b98fb1dc5419d39efd114ab61cbecdfd26","ref":"refs/heads/pretrain_v1t","pushedAt":"2023-08-08T09:35:03.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"remove pupil dilation derivative","shortMessageHtmlLink":"remove pupil dilation derivative"}},{"before":null,"after":"cebb4e73026773e954be9c5825256d800161bc00","ref":"refs/heads/pretrain_v1t","pushedAt":"2023-08-08T09:23:51.000Z","pushType":"branch_creation","commitsCount":0,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"update","shortMessageHtmlLink":"update"}},{"before":"1b3f2ffe9639f7c3709dc3a759b35427db8d0d72","after":null,"ref":"refs/heads/optimization","pushedAt":"2023-08-08T09:02:21.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"}},{"before":"48b3bd9aca4984dab9455e668f932f4be7bb4a74","after":null,"ref":"refs/heads/generalization","pushedAt":"2023-08-08T09:02:19.000Z","pushType":"branch_deletion","commitsCount":0,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"}},{"before":"8651a625ada21cbdb147290c7ad46d2609c60fed","after":"cebb4e73026773e954be9c5825256d800161bc00","ref":"refs/heads/generalization_fix","pushedAt":"2023-07-11T13:57:52.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"update","shortMessageHtmlLink":"update"}},{"before":"b41b5a9bff9248168c1bc9c654bcb6bca9fd0526","after":"8651a625ada21cbdb147290c7ad46d2609c60fed","ref":"refs/heads/generalization_fix","pushedAt":"2023-07-02T09:55:44.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"update limit_data plot to add ViT","shortMessageHtmlLink":"update limit_data plot to add ViT"}},{"before":"a4b9f949a3b7c74060412db06f2d25aa224fa51b","after":"b41b5a9bff9248168c1bc9c654bcb6bca9fd0526","ref":"refs/heads/generalization_fix","pushedAt":"2023-06-27T12:37:29.473Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"update ensemble file","shortMessageHtmlLink":"update ensemble file"}},{"before":"e1abafc2b01a63387c74bfbf8740164c56aa9e9d","after":"a4b9f949a3b7c74060412db06f2d25aa224fa51b","ref":"refs/heads/generalization_fix","pushedAt":"2023-05-10T12:34:03.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"update core input arguments","shortMessageHtmlLink":"update core input arguments"}},{"before":"730263da6336b840a3465f295d8b1a771252b08b","after":"e1abafc2b01a63387c74bfbf8740164c56aa9e9d","ref":"refs/heads/generalization_fix","pushedAt":"2023-05-10T12:24:49.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"update","shortMessageHtmlLink":"update"}},{"before":"6fb830c2749497ddf6ffc497a487cb94f3fe9b6a","after":"730263da6336b840a3465f295d8b1a771252b08b","ref":"refs/heads/generalization_fix","pushedAt":"2023-05-10T10:07:19.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"add Dual PatchNorm ViT","shortMessageHtmlLink":"add Dual PatchNorm ViT"}},{"before":"dd1cb29597ce99fd349391a2d2a86a2fc6fd1d42","after":"6fb830c2749497ddf6ffc497a487cb94f3fe9b6a","ref":"refs/heads/generalization_fix","pushedAt":"2023-05-10T10:01:45.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"clean vit.py file","shortMessageHtmlLink":"clean vit.py file"}},{"before":"e11a12508bb825164b21d1d50f50db4829c4bd48","after":"dd1cb29597ce99fd349391a2d2a86a2fc6fd1d42","ref":"refs/heads/generalization_fix","pushedAt":"2023-05-07T09:30:57.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"update","shortMessageHtmlLink":"update"}},{"before":"d393d4df0fa03dffe524ecaa92805f076d5f6a51","after":"e11a12508bb825164b21d1d50f50db4829c4bd48","ref":"refs/heads/generalization_fix","pushedAt":"2023-05-06T09:19:35.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"update","shortMessageHtmlLink":"update"}},{"before":"aef8ed19180494cfbf836c3c14622446de7a2db7","after":"d393d4df0fa03dffe524ecaa92805f076d5f6a51","ref":"refs/heads/generalization_fix","pushedAt":"2023-05-05T11:04:28.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"einops torch.compile update","shortMessageHtmlLink":"einops torch.compile update"}},{"before":"f625efc0eda74c092164dfb044ebb6b0ab35a8be","after":"aef8ed19180494cfbf836c3c14622446de7a2db7","ref":"refs/heads/generalization_fix","pushedAt":"2023-05-05T10:51:47.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"update","shortMessageHtmlLink":"update"}},{"before":"611b162e0872bcbdaa66200ed9b5983d2c0193e9","after":"f625efc0eda74c092164dfb044ebb6b0ab35a8be","ref":"refs/heads/generalization_fix","pushedAt":"2023-05-05T10:27:31.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"update","shortMessageHtmlLink":"update"}},{"before":"d402da00d2d717e69c4e30c6f430a6605a0585c4","after":"611b162e0872bcbdaa66200ed9b5983d2c0193e9","ref":"refs/heads/generalization_fix","pushedAt":"2023-05-01T11:03:20.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"update","shortMessageHtmlLink":"update"}},{"before":"7b34881451aa1a64892d5dcc4389ed3a4c6b476f","after":"d402da00d2d717e69c4e30c6f430a6605a0585c4","ref":"refs/heads/generalization_fix","pushedAt":"2023-05-01T08:59:13.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"update","shortMessageHtmlLink":"update"}},{"before":"34f9f1c32ff8578a040c99ddd7a0cabf28f7c7f0","after":"7b34881451aa1a64892d5dcc4389ed3a4c6b476f","ref":"refs/heads/generalization_fix","pushedAt":"2023-04-30T16:58:23.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"update","shortMessageHtmlLink":"update"}},{"before":"6a6008699710d2f9fa8907afcd12f3ac659881f2","after":"34f9f1c32ff8578a040c99ddd7a0cabf28f7c7f0","ref":"refs/heads/generalization_fix","pushedAt":"2023-04-30T16:46:52.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"also compute normalized correlation","shortMessageHtmlLink":"also compute normalized correlation"}},{"before":"306e77072409de9de441b4089013eb483f6d7e18","after":"6a6008699710d2f9fa8907afcd12f3ac659881f2","ref":"refs/heads/generalization_fix","pushedAt":"2023-04-29T13:47:37.000Z","pushType":"push","commitsCount":1,"pusher":{"login":"bryanlimy","name":"Bryan M. Li","path":"/bryanlimy","primaryAvatarUrl":"https://avatars.githubusercontent.com/u/9648242?s=80&v=4"},"commit":{"message":"update","shortMessageHtmlLink":"update"}}],"hasNextPage":true,"hasPreviousPage":false,"activityType":"all","actor":null,"timePeriod":"all","sort":"DESC","perPage":30,"cursor":"djE6ks8AAAADbPrJ_wA","startCursor":null,"endCursor":null}},"title":"Activity · bryanlimy/V1T"}