This repository has been archived by the owner on Jul 3, 2023. It is now read-only.
/
CHANGES.txt
1421 lines (827 loc) · 53.8 KB
/
CHANGES.txt
1
2
3
4
5
6
7
8
9
10
11
12
13
14
15
16
17
18
19
20
21
22
23
24
25
26
27
28
29
30
31
32
33
34
35
36
37
38
39
40
41
42
43
44
45
46
47
48
49
50
51
52
53
54
55
56
57
58
59
60
61
62
63
64
65
66
67
68
69
70
71
72
73
74
75
76
77
78
79
80
81
82
83
84
85
86
87
88
89
90
91
92
93
94
95
96
97
98
99
100
101
102
103
104
105
106
107
108
109
110
111
112
113
114
115
116
117
118
119
120
121
122
123
124
125
126
127
128
129
130
131
132
133
134
135
136
137
138
139
140
141
142
143
144
145
146
147
148
149
150
151
152
153
154
155
156
157
158
159
160
161
162
163
164
165
166
167
168
169
170
171
172
173
174
175
176
177
178
179
180
181
182
183
184
185
186
187
188
189
190
191
192
193
194
195
196
197
198
199
200
201
202
203
204
205
206
207
208
209
210
211
212
213
214
215
216
217
218
219
220
221
222
223
224
225
226
227
228
229
230
231
232
233
234
235
236
237
238
239
240
241
242
243
244
245
246
247
248
249
250
251
252
253
254
255
256
257
258
259
260
261
262
263
264
265
266
267
268
269
270
271
272
273
274
275
276
277
278
279
280
281
282
283
284
285
286
287
288
289
290
291
292
293
294
295
296
297
298
299
300
301
302
303
304
305
306
307
308
309
310
311
312
313
314
315
316
317
318
319
320
321
322
323
324
325
326
327
328
329
330
331
332
333
334
335
336
337
338
339
340
341
342
343
344
345
346
347
348
349
350
351
352
353
354
355
356
357
358
359
360
361
362
363
364
365
366
367
368
369
370
371
372
373
374
375
376
377
378
379
380
381
382
383
384
385
386
387
388
389
390
391
392
393
394
395
396
397
398
399
400
401
402
403
404
405
406
407
408
409
410
411
412
413
414
415
416
417
418
419
420
421
422
423
424
425
426
427
428
429
430
431
432
433
434
435
436
437
438
439
440
441
442
443
444
445
446
447
448
449
450
451
452
453
454
455
456
457
458
459
460
461
462
463
464
465
466
467
468
469
470
471
472
473
474
475
476
477
478
479
480
481
482
483
484
485
486
487
488
489
490
491
492
493
494
495
496
497
498
499
500
501
502
503
504
505
506
507
508
509
510
511
512
513
514
515
516
517
518
519
520
521
522
523
524
525
526
527
528
529
530
531
532
533
534
535
536
537
538
539
540
541
542
543
544
545
546
547
548
549
550
551
552
553
554
555
556
557
558
559
560
561
562
563
564
565
566
567
568
569
570
571
572
573
574
575
576
577
578
579
580
581
582
583
584
585
586
587
588
589
590
591
592
593
594
595
596
597
598
599
600
601
602
603
604
605
606
607
608
609
610
611
612
613
614
615
616
617
618
619
620
621
622
623
624
625
626
627
628
629
630
631
632
633
634
635
636
637
638
639
640
641
642
643
644
645
646
647
648
649
650
651
652
653
654
655
656
657
658
659
660
661
662
663
664
665
666
667
668
669
670
671
672
673
674
675
676
677
678
679
680
681
682
683
684
685
686
687
688
689
690
691
692
693
694
695
696
697
698
699
700
701
702
703
704
705
706
707
708
709
710
711
712
713
714
715
716
717
718
719
720
721
722
723
724
725
726
727
728
729
730
731
732
733
734
735
736
737
738
739
740
741
742
743
744
745
746
747
748
749
750
751
752
753
754
755
756
757
758
759
760
761
762
763
764
765
766
767
768
769
770
771
772
773
774
775
776
777
778
779
780
781
782
783
784
785
786
787
788
789
790
791
792
793
794
795
796
797
798
799
800
801
802
803
804
805
806
807
808
809
810
811
812
813
814
815
816
817
818
819
820
821
822
823
824
825
826
827
828
829
830
831
832
833
834
835
836
837
838
839
840
841
842
843
844
845
846
847
848
849
850
851
852
853
854
855
856
857
858
859
860
861
862
863
864
865
866
867
868
869
870
871
872
873
874
875
876
877
878
879
880
881
882
883
884
885
886
887
888
889
890
891
892
893
894
895
896
897
898
899
900
901
902
903
904
905
906
907
908
909
910
911
912
913
914
915
916
917
918
919
920
921
922
923
924
925
926
927
928
929
930
931
932
933
934
935
936
937
938
939
940
941
942
943
944
945
946
947
948
949
950
951
952
953
954
955
956
957
958
959
960
961
962
963
964
965
966
967
968
969
970
971
972
973
974
975
976
977
978
979
980
981
982
983
984
985
986
987
988
989
990
991
992
993
994
995
996
997
998
999
1000
Apache OODT Change Log
======================
=======
Release 2.0 - In Progress
NOTE: Avro RPC becomes the default method of communication from this version. XML RPC is made deprecated.
* OODT-1006 Introduce docker images for file manager, resource manager, ReactJs based OPSUI and file manager/workflow manager REST APIs
* OODT-1006 Add Dockerfile for OODT deployment
=======
Release 1.9.1 - 25/09/2021
* OODT-1031 OODT 1.9 should default to XMLRpc versions of FM/RESMGR/WMGR instead of Avro versions
=======
Release 1.9 - 30/09/2019
* OODT-973 Update mvn/archetypes/radix module script templates to remove ghost PID files (ThejanW via mattmann)
* OODT-969 Tests for Avro File Manager client and server (imesha via mattmann)
* OODT-970 Netty Transceiver throws an NPE (imesha via mattmann)
* OODT-951 Wrong null checker (JC via mattmann)
* OODT-972 Add filemgr.server and filemgr.client configuration keys to Radix filemgr.properties (lewismc via mattmann)
* OODT-964, OODT-963 Fix issues merging Distributed ZK Config module into Avro-RPC branch (imesha,mattmann)
* OODT-957 Add CVE reporting plugin to maven build chain
* OODT-958 Update commons-collections
* OODT-959 Update tika to 1.16
* OODT-968 Add metadata removes product
* OODT-991 Change logging.properties levels from ALL to DEBUG
* OODT-998 Updated cas-filemgr shell scripts to work when distribution is located in a path with spaces
=======
Release 1.2.2 - 02/05/2018
* OODT-968 Add metadata removes product
=======
Release 1.2.1 - 11/10/2017
* OODT-967 Solr version for 1.2.1 breaks SolrDumper in File Manager (mattmann)
Release 1.2 - 08/14/2017
* OODT-955 Fix numhits error in Lucene Catalog (magicaltrout)
* OODT-956 Add connection checks to components (magicaltrout)
Release 1.1 - 07/18/2017
*** NOTE: A change was introduced in this version that causes a forced upgrade to your
Lucene Workflow Instance repository catalog. If you are using Lucene in the workflow manager,
the best bet is to blow away your old workflow instance catalog, and then allow it to be
rebuilt automatically. You can detect if you are affected by this issue if you see a message
akin to the below.
Jul 19, 2017 10:45:02 AM org.apache.oodt.cas.workflow.instrepo.LuceneWorkflowInstanceRepository addWorkflowInstanceToCatalog
WARNING: Unable to index workflow instance: [d8dad567-6c90-11e7-9e4e-7574e3a12106]: Message: Format version is not supported
(resource BufferedChecksumIndexInput(MMapIndexInput(path="/project/oodt/dev/jedi/data/workflow/slothrop/segments"))): -1 (needs
to be between 1071082519 and 1071082519). This version of Lucene only supports indexes created with release 5.0 and later.
java.lang.NullPointerException
****
* OODT-954 CAS-PGE FileManagerFileStager has NPE b/c it does not set Product Structure (mattmann)
* OODT-526 Add base functionality in Curator for Task List persistence (mjoyce, mattmann)
* OODT-525 Export IngestTaskList from Curator (mjoyce, mattmann)
* OODT-304 Add a Getter method to get the file handler configuration (Michael Cayanan via mattmann)
* OODT-877 Fix 2 failures in o.a.o.commons.util.XMLTest on Windows 2008 Server (lewismc, mattmann)
* OODT-305 Make the Resource Manager manage different queues of jobs independently (resneck, mattmann)
* OODT-753 Move FM and WM Python APIs into "agility" component (kelly, mattmann)
* OODT-563 Task editing and Workflow execution (varun, mattmann)
* OODT-212 Rollback capability for Workflows (sherylj via mattmann)
* OODT-836, OODT-837 Remove Non-Essential Components (mattmann, mdstarch, magicaltrout)
* OODT-213 Reading/Writing API for XML-based Workflow Task policy (mattmann)
* OODT-775 XSD's for pushpull's mimetypes.xml (Lewis John McGibbney via mattmann)
* OODT-847 New FilemgrMetExtractor to extract File System Attributes (Aditya Dhulipala, rverma via mattmann)
* OODT-948 Fix dockerfile (magicaltrout/R B Krishna)
* OODT-938 update netcdf (magicaltrout)
* OODT-943 update javadoc and site plugin versions (magicaltrout)
* OODT-931 CAS Crawler and metadata preconditions should say what preconditions
failed (mattmann)
* OODT-932 OODT-Core forces javadoc to run and fails on linting - it shouldn't
do that (mattmann)
* OODT-929 EnvUtilities should only load environment variables one time and
statically cache them (mattmann)
Release 1.0 - 06/21/2016
* OODT-925 - Update schema.xml field defs for SOLR 5.x
* OODT-926 - Fix pom versioning
* OODT-927 - Sanitize SQL commands in CAS DatasourceIngestMapper
* OODT-928 - UPdate maven-compiler-plugin
Release 0.12 - 02/10/2016
* OODT-781 Add missing XMLRPC endpoint for remove hashtable. (magicaltrout)
* OODT-923 Fix start script for solr deployments (magicaltrout)
* OODT-924 Fix missing timestamp metadata field in returned data from solr (magicaltrout)
* OODT-992 Fix incorrect product count for solr backed store (magicaltrout)
Release 0.11 - 12/29/2015
* OODT-918 - Created a prerequisite workflow condition for DRAT (Karanjeet
Singh via mattmann)
* OODT-913 Multiple metadata values not written out into product-types.xml (luca)
* ODT-862 Include the Workflow ID as part of the standard metadata (luca)
* OODT-885 RegEx Precondition Comparator for DRAT --exclude feature (Karanjeet
Singh via mattmann)
* OODT-874 Corrected workflow/bin/wmgr and resource/bin/resmgr to make sure
they both delete the cas.xxxx.pid file when stopped using the 'stop'
command. (mallder)
* OODT-872 Upgrade Jena dependencies to org.apache.jena 3.0.0 (lewismc, mattmann)
* OODT-882 Merge dependency update into master (magicaltrout)
* OODT-887 Prevent DNS resolution on URL Lookup (magicaltrout)
* OODT-888 Replace += with StringBuilders to improve performance (magicaltrout)
* OODT-889 Fix TopN with Type (magicaltrout)
* OODT-891 Add clover placeholder(waiting on license from Atlassian) (magicaltrout)
* OODT-892 Tidy up null assignments (magicaltrout)
* OODT-755 Fix error message in FM client when ingestion fails - code quality from sonar (magicaltrout)
* OODT-894 Remove inefficient constructors - code quality from sonar (magicaltrout)
* OODT-909 create more explicit exceptions - code quality from sonar (magicaltrout)
* OODT-907 remove never queries collections - code quality from sonar (magicaltrout)
* OODT-906 remove redundant assignments - code quality from sonar (magicaltrout)
* OODT-904 remove redundant throws - code quality from sonar (magicaltrout)
* OODT-903 simplify flows - code quality from sonar (magicaltrout)
* OODT-902 remove redundant modifiers from enums - code quality from sonar (magicaltrout)
* OODT-901 resolve javadoc issues - code quality from sonar (magicaltrout)
* OODT-900 remove boxing/unboxing etc in code - code quality from sonar (magicaltrout)
* OODT-899 remove redundant local variables - code quality from sonar (magicaltrout)
* OODT-898 remove redundant finals - code quality from sonar (magicaltrout)
* OODT-897 remove module dependencies - code quality from sonar (magicaltrout)
* OODT-896 remove interface modifers - code quality from sonar (magicaltrout)
* OODT-895 remove redundant measure unit - code quality from sonar (magicaltrout)
* OODT-894 tidy up inefficient constructors - code quality from sonar (magicaltrout)
* OODT-912 replace print stacttraces with log output - code quality from sonar (magicaltrout)
Release 0.10 - 08/30/2015
* OODT-871 Issues with OODT 0.10 RC#1 (lewismc, mattmann)
* OODT-246 Give user the ability to print a detailed report on what jobs in
the Resource Manager are running on what nodes (Gabe Resneck, mattmann)
* OODT-245 List results from the Resource Manager client should be sorted
alphabetically (Gabe Resneck via mattmann)
* OODT-248 Give user the ability to print a detailed report on the load, capacity
and queues of all nodes in the Resource Manager (Gabe Resneck, mattmann)
* OODT-247 Resource Manager client should allow users to see what jobs are
currently in the queue (Gabe Resneck, mattmann)
* OODT-244 Allow the Resource Manager scheduler to cycle on a non-integer
number of seconds (Gabe Resneck via mattmann)
* OODT-864 Upgrade to Tika 1.10 (mattmann,tpalsulich)
* OODT-686 AddProductTypeCliAction should prompt for ProductTypeId (rverma, mattmann)
* OODT-302 Add support in the xmlquery package to handle HTTP Redirection (Michael Cayanan via mattmann)
* OODT-303 Add support in the Grid Package to throw an HTTP Servlet Response (Michael Cayanan via mattmann)
* OODT-480 Balance: default view not found (Nesbert Hidalgo via mattmann)
* OODT-598 XMLQuery DIS-style query parser needs to treat "#" as a word character (kelly via mattmann)
* OODT-870 Integrate Curator into OPSUI (mattmann)
* OODT-842 create restful version of cas curator services (mattmann)
* OODT-838 Separate RESTful Servers and Clients (Michael Starch, mattmann)
* OODT-824 Port the Curator to Apache Wicket (mattmann)
* OODT-861 Workflow Manager client will print the list of task ids for a given workflow, if requested (luca)
* OODT-854 Enable File Manager and Resource Manager to collect configuration files by parsing a directory tree recursively (luca)
* OODT-781 Fix removal of files from the LocalDataTransferer (magicaltrout)
Release 0.9 - 05/31/2015
* OODT-841 Update Maven instructions in README to include clean command (Ethan Wang via mattmann)
* OODT-844 Scala maven plugin for streaming only (Jane Wyngaard via mattmann)
* OODT-829 Implement an Apache Tika based Server Side Extractor (Radu Manole via mattmann)
* OODT-826 Add the capability to check external preconditions before ingesting a file.
* OODT-832 Move streaming items to seperate top-level component (starchmd)
* OODT-831 CAS PGE adapter framework build failed (Aditya Dhulipala via mattmann)
* OODT-830 Queue Assertion failure of XmlQueueRepository under CAS Resource Manager (Aditya Dhulipala via mattmann)
* OODT-823 OODT JDK8 Maven3 build errors (Aditya Dhulipala via mattmann)
* OODT-715 SolrIndexer fails to index when numProducts == pageSize (pramirez, mdstarch via mattmann)
* OODT-821 OODT-821 FMProd RDF conf shouldn't use EDRN as a default namespace for keys and for types (mattmann)
* OODT-818 CmdLineIngester should log there was an exception and move on during ingest (mattmann)
* OODT-817 TikaCmdLineExtractor needs to add Filename and FileLocation fields (mattmann)
* OODT-813 CAS-PGE incorrectly passes varargs to DynamicConfigFile implementations (mattmann)
* OODT-812 RADIX ingest script (mattmann)
* OODT-811 RADIX incorrectly sets up PCS REST services app config (mattmann)
* OODT-810 Metadata PreCondition Comparators based on FileName and LastModified time (Luca Cinquini via mattmann)
* OODT-809 A CrawlerAction that indexes to Solr (Luca Cinquini via mattmann)
Release 0.8.1 - 01/28/2015
-------------------------------------------
* OODT-804 Broken trunk build on Jenkins
* OODT-699 Mesos cluster manager backend to resource manager
* OODT-780 Spark backend to resource manager
* OODT-802 Create Dockerfile for OODT Radix.
* OODT-761 Update PGE version in Radix.
* OODT-749 Remove old XercesImpl jar from grid pom.
* OODT-771 Fix push_pull_framework.properties path reference for config.external.properties.files in incorrect with a patch from Lewis
* OODT-770 Fix the RADIX Issues with a patch from Lewis McGibbney
Release 0.8 - 12/19/2014
--------------------------------------------
* OODT-751 OPSUI pages constantly expire (Tom Barber, mattmann)
* OODT-748 Fix Description in agility/setup.py
* OODT-787 PGE_ROOT env variable does not work in PGEConfig.xml and tasks.xml (Yi Sun, Sneha Deshmukh via mattmann)
* OODT-562 Exposing parent-child & element addition/deletion functionality for product types using cas-curator (varunr)
* OODT-563 Modifying Workflow Manager to allow adding new workflows (varunr)
* OODT-786 Change shebang to bash for proper color output (Poojit Sharma via mattmann)
* OODT-785 Update batch stub with legacyMode set to true (meghamsh4 via mattmann)
* OODT-783 RADiX Crawler action bean config refers to WORKFLOWMGR_URL (Angela Wang via mattmann)
* OODT-782 Resource manager port number must be compatible with the one used in workflow.properties (Imran Mammaldi via mattmann)
* OODT-769 The wiki page command installs 0.6 version of the oodt radix installer (lewismc, Santosh SHankar)
* OODT-777 Update fileconcatenator-pge.tar for building fileconcatenator-pge (threeears via mattmann)
* OODT-776 Test fix: log messages can be different for different locales (Tom Tung via mattmann)
* OODT-701 Adding in stream product structure for filemanager. Add in check for valid product structures, and fixed tests breaking from that check.
* OODT-699 Adding in cluster managment scripts for mesos.
* OODT-764 Adding in multiplexing resource manager backend.
* OODT-763 Correcting path to OODT_HOME and FILEMGR_HOME (vishalhemnani via mattmann)
* OODT-385, OODT-630, OODT-631, OODT-632. Upgraded Tika to version 1.6.
* OODT-757 Fixed PGETaskInstance bug that prevented instantiation of AutoDetectProductCrawler (luca)
* OODT-756 HttpClient NoClassDefFoundError For the url-downloader Script (Mengying Wang via mattmann)
* OODT-754 Contribute ProdTypePatternMetExtractor (rickdn)
* OODT-750 Issue with running mvn site:site due to old findbugs plugin (mattmann)
Release 0.7 - 09/15/2014
--------------------------------------------
* OODT-669 Make Resource Manager work without Ganglia (mattmann, rajith)
* OODT-644 Fix to FTP protocol tests, abstracting some of the logic to make the code better suited to mocking(magicaltrout)
* OODT-644 Fix to stub FTP client protocol so it doesn't fail when the port is in use
* OODT-644 Partial fix to stub SSH client so it doesn't fail when SSHD is running locally
* OODT-745 Removed trailing spaces in the radix wmgr filex
* OODT-473 Rremove "Deleted" Metadata Flag from Solr Indexer (magicaltrout)
* OODT-736 Clean up test data left by TestTypeHandler test (rlaidlaw)
* OODT-667 CAS-PGE no longer respects writers and file tags from
earlier pgeConfig.xml files (mattmann)
* OODT-741 Remove static modifier from elementMap, subToSuperMap and
productTypeElementMap fields in XMLValidationLayer (rlaidlaw)
* OODT-737 Copied over latest cmd-line-options.xml with typeName (rlaidlaw)
* OODT-739 Fix File Manager unit tests (step 12) - fix test classes in
'metadata' and 'versioning' packages (rlaidlaw)
* OODT-738 Contribute workflow scripts to kill all by status or kill by instance ID (mattmann)
* OODT-737 Fix File Manager unit tests (step 11) - fix test classes in 'cli'
package (rlaidlaw)
* OODT-736 Fix File Manager unit tests (step 10) - fix test classes in 'structs'
package (rlaidlaw)
* OODT-735 Fix File Manager unit tests (step 9) - fix test classes in 'tools'
package (rlaidlaw)
* OODT-734 Fix File Manager unit tests (step 8) - fix test classes in 'system'
package (rlaidlaw)
* OODT-733 Fix File Manager unit tests (step 7) - fix test classes in 'ingest'
package (rlaidlaw)
* OODT-732 Fix File Manager unit tests (step 6) - fix test classes in
'datatransfer' package (rlaidlaw)
* OODT-731 Fix File Manager unit tests (step 5) - fix test classes in 'catalog'
package (rlaidlaw)
* OODT-728 Figure out why certain metadata fields get set twice during pipeline processing (mattmann)
* OODT-729 Fix File Manager unit tests (step 4) - fix test classes in 'util'
package (rlaidlaw)
* OODT-690 RADiX example policy for GenericFile missing "<metadata/>" node (rverma via mattmann)
* OODT-718 RADiX Build Failure (tpalsulich, goodale via mattmann)
* OODT-726 Create MetFilter Task Example (mattmann)
* OODT-724 Crawler action bean config refers to WORKFLOWMGR_URL (mattmann)
* OODT-723 Fix File Manager unit tests (step 3) - fix test class in 'validation'
package (rlaidlaw)
* OODT-722 Fix File Manager unit tests (step 2) - fix test class in 'repository'
package (rlaidlaw)
* OODT-672 OODT Start script does not notify user of status (asumarlidason via mattmann)
* OODT-721 Fix File Manager unit tests (step 1) - remove duplicate XML from test
resources (rlaidlaw)
* OODT-719 Prevent httpclient from spawning closewait tcp connections (Konstantinos Mavrommatis via lewismc)
* OODT-685 ix OODT 0.7-SNAPSHOT Jenkins nightly build on Ubuntu 1st Pass (lewismc)
* OODT-716 Vagrant user on VM unable to start/stop oodt services (sherylj)
* OODT-708 Add PGE RADiX Archetype (skhudiky)
* OODT-593 Dyn workflows in Workflow Manager cause NPEs on restart (mattmann)
* OODT-705 RADIX one step script (mattmann)
* OODT-703 DataUtil.createProductZipFile throws exception when creating a zipfile of a hierarchical product (thomas)
* OODT-674 MoveDatafileToFailureDir fails to move files off an NFS mounted directory (thomas)
* OODT-662 Upgrade cog-jglobus dependency in protocol-ftp (lewismc)
* OODT-668 ProductQueryServlet will now rename zip attachments with proper ".zip" extension,
and the conventions used can be overridden by subclasses (luca)
* OODT-217 CAS-PGE User Manual (rverma, bfoster, mattmann)
* OODT-665 CAS RDF and RSS product service doesn't allow product type met to have keys
with spaces (mattmann)
* OODT-664 RADIX deployment of opsui incorrectly uses /pcs-opsui as the web.xml context
and omits 2 key PCS properties from context.xml (mattmann, pramirez, ahart)
* OODT-663 Sample CAS-PGE workflow task should be included in cas-pge (mattmann)
* OODT-661 Enabled case-insensitive specification of "OFSN" and "RT" parameter names
(not values!) when issuing a request to the Product Server (luca)
* OODT-656 Provide alternative implementation of QueryServlet that is able
to construct queries from non DIS-style parameters (luca)
* OODT-613 CAS Product web application - configurable content writers for RDF
and RSS (rlaidlaw)
* OODT-612 CAS Product web application - add content writers for XML, JSON, RDF,
RSS (rlaidlaw)
* OODT-652 New TikaCmdLineMetExtractor (riverma)
* OODT-651 Improve parameter initialization, validation and logging for
CAS-Product web application (rlaidlaw)
* OODT-650 Remove duplicate context container example from CAS-Product web
application (rlaidlaw)
* OODT-649 Add PathUtils.replaceEnvVariables wrapper around calls to
context.getInitParameter to process environment variables (rlaidlaw)
* OODT-611 Implement JAX-RS services to access File Manager products as raw
data (rlaidlaw)
* OODT-648 Add license headers to files so that mvn rat:check is successful
(lewismc)
* OODT-642 In CAS-Product, moved tests to src/test/java and test resources to
src/test/resources to match Maven standard directory layout (rlaidlaw)
* OODT-619 Implement the capability to pull status of resource
nodes from ganglia (Rajith Siriwardana via mattmann)
Release 0.6 - 07/08/2013
--------------------------------------------
* OODT-633 Update PEAR package.xml files for upcoming release. (gmcdonald)
* OODT-640 Added version number for maven-war-plugin to CAS-Product POM
(rlaidlaw)
* OODT-639 Add a versioner based on Product Type Metadata (mattmann)
* OODT-638 Include more provenance metadata in trace product type (mattmann)
* OODT-637 Geo Product Type policy includes duplicative elements (mattmann)
* OODT-635 Fix trivial errors in Basic CAS Curation Example (lewismc via mattmann, Bill Rideout)
* OODT-636 Fixed Javadoc warnings in CAS-Product (rlaidlaw)
* OODT-634 Fixed lingering bug in Solr Catalog implementation that would still not return null
if no matching product is found (luca)
* OODT-628 Multiple cluster Ganglia xml parse error (Rajith Siriwardana via mattmann)
* OODT-610 Added new empty package oodt.cas.product.service for future JAX-RS
classes (rlaidlaw)
* OODT-609 Added Apache CXF dependency to the CAS-Product POM (rlaidlaw)
* OODT-624 Updated maven-javadoc-plugin to v2.9 (rlaidlaw)
* OODT-623 Addition of relativePath to the opendapps/pom.xml to help it locate
the oodt-core POM (rlaidlaw)
* OODT-618 Implement ganglia XML parser (Rajith Siriwardana via mattmann)
* OODT-625 Bake TraceableFile product policy into FM (mattmann)
* OODT-622 Updated svn:ignore properties for several modules to add Eclipse
configuration files to the ignore lists (rlaidlaw)
* OODT-572 Replace mkdir with more multi-thread resilient forceMkdir in
LocalDataTransferer (Tom Barber via mattmann)
* OODT-559 Unit test failure in testDoDynamicReplacement for "Europe/London"
timezone (Tom Barber via mattmann)
* OODT-615 Fixed bug in SolrCatalog that would throw exception if no matching products are found
(luca)
* OODT-408 Drop Spring logging levels from WARNING to SEVERE (Lewis John McGibbney
via mattmann, bfoster)
* OODT-607 SciPgeWriter that is a simple MetKey template replacer (mattmann)
* OODT-606 SciPgeWriter that uses ApacheVelocity (mattmann, pramirez)
* OODT-592 Provide Solr-based implementation of CAS File Manager (luca)
* OODT-590 modify pcs references in opsui webapp (riverma)
* OODT-589 add pcs_home env variable to env script (riverma)
* OODT-586 RADiX archetype does not properly deploy crawler (riverma)
* OODT-603 Enable Resource Manager start/stop within RADiX (riverma)
* OODT-600 Modularize old OPSUI theme into a separate Wicket "skin" (riverma)
* OODT-599 Modularize new theme into a stand-alone Wicket "skin" (riverma)
* OODT-597 Improve theme/styling of OPSUI (riverma)
* OODT-596 Fix opsui webapp's wicket 'Page Expired' error (riverma)
* OODT-595 Improve styling of Workflow Viewer (webapp/components) (riverma)
* OODT-602 Load not settable for WorkflowTaskJobs in
IterativeWorkflowProcessThread (mattmann)
* OODT-470 Enabled RSSProductTransferServlet to be configured using an XML
configuration file (rlaidlaw)
* OODT-560 XmlStructFactory::getProductTypeMapXmlDocument does not
output virtual product types (Varun Ratnakar via mattmann)
* OODT-583 Added JUnit test class for RSSConfigReader (rlaidlaw)
* OODT-582 Fix for oodt.cas.product.rss.RSSConfigReader.readTags() for detection
of source attribute for tags defined in the RSS configuration file (rlaidlaw)
* OODT-576 Used try...finally in oodt.commons.database.SqlScript.loadScript() to
close BufferedReader (rlaidlaw)
* OODT-537 Push/Pull NullPointerException on startup (mattmann, joyce)
* OODT-578 Workflow Monitor experiences runtime exception (NPE) out
of the box with RADIX (Arni Sumarlidason via mattmann)
* OODT-575 Metadata extractor for parsing filename based on regex
(Nga Chung via mattmann)
* OODT-573 Refactored the return statement in the getTopNProducts method in the
LuceneCatalog class (rlaidlaw)
* OODT-571 Updated assignments in setWorkflowInst and setWaitforConditionSatisfy
methods in IterativeWorkflowProcessorThread class (rlaidlaw)
* OODT-574 RADiX POM Parent References (Arni Sumarlidason via mattmann)
* OODT-491 Add nextState (determineNextState) function to
WorkflowProcessor (mattmann)
* OODT-558 Introducing optional web-grid servlet init parameter "org.apache.oodt.grid.GridServlet.config"
that can be used to read/write its configuration to a location external to the web app directory (luca).
* OODT-564 XMLPS should provided ordered results based on
requested fields (mattmann, joyce)
* OODT-369 Building with Maven3 (mattmann, Adam Estrada)
* OODT-555, OODT-557 - Changed behavior of Lucene Catalog update methods to retrieve a product from the index to the cache,
instead of failing if it is not found in the cache. At the same time, simplify the Curator updateMetadata() method to just update
the metadata, without removing and re-inserting the product before that.
(luca, rishi, mattmann)
* OODT-553 Update org.apache.oodt.commons.exec.EnvUtilities to Use System.getEnvironment
(Michael Starch via mattmann)
* OODT-551 Insert primary key in metadata table for database-based File Manager, to always return metadata values in proper order
(luca, mattmann, bfoster)
* OODT-548 Be more resilient to table definitions matching the master table
in the Mapping config file (mattmann,joyce)
* OODT-546 XMLPS inner-joins default table with itself (mattmann,joyce)
* OODT-547 Switch newest Curator upudate metadata method to use XML-RPC FileManager client.
Switch other Curator update metadata method to use shared instance of Catalog Factory
to minimize use of resources.
(luca)
Release 0.5
--------------------------------------------
Release Date: December 18, 2012
* OODT-541 Implement a LenientDataSourceCatalog that allows for dynamically named
metadata fields, effectively bypassing the validation layer.
(luca)
* OODT-544 Implement a DataSourceCatalog back-end to the CAS FileManager
where the "product_id" column is of type string.
(luca)
* OODT-545 Allow Curator web app to use a configurable CAS Catalog Factory
as specified in curator.xml.
(luca)
* OODT-543 Update ExpImpCatalog tool to allow core Metadata to pass through
when Embedded Catalogs are used (mattmann, cinquini)
* OODT-542 Need to update logging.properties for all servers post CAS CLI
(mattmann)
* OODT-535 Provide capability to remove metadata tags through Curator
web app. (luca)
* OODT-533 Allow SolrIndexer to query and ingest products from the File
Manager catalog by name. (luca)
* OODT-534 Better error message when a product is looked by id in the catalog
and not found. (luca)
* OODT-529 Allow Lucene Catalog to be "lenient" with respect to XML validation,
i.e. allow handling of dynamically named fields if the "lenient" flag is set
(defaults to false). (luca)
* OODT-530 Bug fix: crawler MetExtractorProductCrawler had a list of precondition
beans that was not initialized to an empty list, with would cause a Spring
initialization exception when more than one preconditions was injected. (luca)
* OODT-531 Bug fix: the legacy Spring configuration file legacy-cmd-line-options.xml
was missing some required configuration for the beans "noRecur" and "crawlForDirs".
(luca)
* OODT-532 Bug fix: pre-condition bean "AprioriUniquessCheckWithFilemgr" was missing
the filemgrUrl property, which was therefore never set at initialization. (luca)
* OODT-522 Provided additional Curator REST endpoint: "/metadata/update" that updated
product metadata in place, i.e. preserves all existing catalog metadata (luca)
* OODT-523 Updated Curator CXF dependency to 2.6.0 and removed FIXME patch to
extract "id" from "/metadata/catalog" request (luca)
* OODT-528 Merged back changed to CuratorLuceneCatalog into File Manager LuceneCatalog,
and change Curator to use mainstream File Manager Lucene Catalog (luca)
* OODT-272 Enable Removal of Finished Ingestion Tasks
(Michael Joyce via mattmann)
* OODT-328 Remove jpl.nasa.gov references from code
(Michael Joyce via mattmann)
* OODT-520 Default Crawler launcher doesn't reference FileManager
properties (Mike Joyce via mattmann)
* OODT-502: Support pre and post conditions in Workflow Processor
Queue (mattmann)
* OODT-516: Add WorkflowLifecycle tests that check pctComplete for
wengine and w1 style lifecycles (mattmann)
* OODT-501: Method to create Processor from Instance should be based on
Graph structure (mattmann)
* OODT-511: Solr Indexer Date Formatting Removes Metadata (pramirez)
* OODT-510: SolrIndexer fails on ProductTypes that have 0 products (pramirez, ahart)
* OODT-496: Convert EngineRunner interface to take TaskProcessor (mattmann)
* OODT-505: Remove synchronous Runner (mattmann)
* OODT-498: Overwrite and bring back 0.3 ThreadPoolWorkflowEngine plus
patches (mattmann)
* OODT-500: Rename property for max threads in AsyncLocalEngineRunner (mattmann)
* OODT-497: Make WorkflowProcessor PrioritySorters thread-safe (mattmann)
* OODT-492: Refactor Workflow Instance repo to store/retrieve that state
information (mattmann)
* OODT-490: Refactor WorkflowProcessor to push all of its state information
into Workflow Instance (mattmann)
* OODT-432: Add FileSize to know metadata fields set by CAS-Crawler
(bfoster via mattmann)
* OODT-381: Create Runner framework to allow flexible WorkflowTask
execution on different runtimes (mattmann, bfoster)
* OODT-215: Workflow2 Architecture (mattmann, bfoster, sherylj)
* OODT-310: Port WEngine to trunk (mattmann, bfoster, sherylj)
* OODT-487: MetadataBasedProductMover to handle when the source and destinations match (cgoodale)
* OODT-488: Enhanced Solr Indexer capabilities (pramirez)
* OODT-390: Removal of optimize call in Lucene Workflow Instance Repository (pramirez)
* OODT-486: WorkflowInstance tries to cast null strings into dates causing
exceptions on getters/setters (mattmann)
* OODT-483: Fix to prevent NumberFormatException in XmlRpcStructFactory (rlaidlaw)
* OODT-471: Added namespace definitions to RSS config files for CAS REST API (rlaidlaw)
* OODT-469: Modified RSSProductServlet to remove hard-coded namespaces and allow
configurable namespaces via RSS config files (rlaidlaw)
* OODT-485: Factory out EngineRunner and WorkflowProcessor classes into their own packages (bfoster)
* OODT-481: CAS-Pushpull uniqueMetadataElement is being loaded as empty String instead of null (bfoster)
* OODT-474: Fixed the probem having in a configuration file
ProtocolFactoryInfo.xml (mattmann, YunHee Kang)
* OODT-478: Balance: New hook for hooks.php (nhidalgo via ahart)
* OODT-476: RemoteSiteFile doesn't always set RemoteSite (bfoster)
* OODT-477: CommonsNetFtpProtocol throws exception on successful download (bfoster)
* OODT-329: OODT PEAR Channel (Gavin McDonald via mattmann)
* OODT-472: Puny Module - Return to previous page once the user is done editing (skhudiky)
* OODT-467: Change SciPgeConfigFileWriter to DynamicConfigFileWriter (bfoster)
* OODT-464: Add file staging support to CAS-PGE's XmlFilePgeConfigBuilder (bfoster)
Release 0.4
--------------------------------------------
Release Date: June 13th, 2012
* OODT-446 Addition of Puny module to Balance (skhudiky)
* OODT-462: Include support for special processing instructions in opendap-ps configuration file (luca)
* OODT-463: Ignore container-type DAS attributes when parsing metadata in opendap-ps module (luca)
* OODT-402: Provided default File Manager policy and RSS configuration for
products with location metadata. See subtasks OODT-449, 452 and 453. (rlaidlaw)
* OODT-449: Added default GeoRSS configuration file for the CAS REST RSS service. (rlaidlaw)
* OODT-452: Moved File Manager policy files for GenericFile type (elements.xml, product-types.xml,
product-type-element-map.xml) to filemgr/src/main/resources/examples/core subdirectory.
Updated six unit tests to use the new subdirectory. (rlaidlaw)
* OODT-453: Added File Manager policy files for simple LocationAwareProduct
(elements.xml, product-types.xml, product-type-element-map.xml). (rlaidlaw)
* OODT-457: add missing Datatables images for paging through Cas-browser index page (skhudiky)
* OODT-455 Small CSS tweak for the OPSUI Wicket App (cgoodale)
* OODT-451 Implemented CAS metadata precondition class to check for existence of given marker file
within product directory (luca)
* OODT-445 Extend env replace support introduced in OODT-343 (ahart)
* OODT-444 Utils class missing from Balance cas-browser module (ahart)
* OODT-448 added missing character (skhudiky)
* OODT-447 changed reference to CAS-SSO directory in the profile management module README.txt (skhudiky)
* OODT-450 Crawler being able to delete a non-empty product directory
upon successful product ingestion (luca)
* OODT-421 Make WorkflowLifecycleManager understand
WorkflowStates (mattmann)
* OODT-440 Replace legacy getMetadata("UUID") calls with
getMetadata("CAS." + CoreMetKeys.PRODUCT_ID) (thomas)
* OODT-442 Apache project branding requirements: DOAP
file [PATCH] (Shane Curcuru via mattmann)
* OODT-438 Make CAS-Crawlers MimeExtractorConfigReader relative file paths be relative to its
XML file (bfoster)
* OODT-426 Introduce a CAS-Metadata based renaming interface (bfoster)
* OODT-435 Refactor Graph and ParentChildWorkflow class
outside of PackagedWorkflowRepository (mattmann)
* OODT-157 PCS Operator User Interface web application
(mattmann, ahart, cgoodale, pramirez)
* OODT-401 added profile management module to balance modules directory (skhudiky)
* OODT-433 Fix retrieveFileByName and retrieveFileById buy setting the product's references
before calling retrieveProduct (thomas)
* OODT-430 Update all boolean type bean properties in the crawler cmd-line-options.xml (thomas)
* OODT-412 Bugfix: MoveMetadataToFailureDir should read MoveMetadataFileToFailureDir (thomas)
* OODT-428 CrawlerBeansPropHandler doesn't set list properties for Spring
PropertyOverrideConfigurer correctly (bfoster)
* OODT-429 filemgr query throws NPE when sorting by key with possibly empty values (rickdn)
* OODT-427 filemgr query throws "String index out of range: -1" when some products have undefined
metadata values (rickdn)
* OODT-405 Introduced new syntax for environment variable replacement in opendapps module (luca)
* OODT-425 CAS-PGE logger unit-test fails because it sometimes finds logger lock file (bfoster)
* OODT-422 Allow for CAS-PGE PgeMetadata to be dumped to an xml
file after initialization (bfoster)
* OODT-410 DataSourceCatalog compatible with HypersonicSQL
(mattmann,rickdn,bfoster,pramirez)
* OODT-413 filemgr query throws NPE when some products have undefined metadata values (rickdn)
* OODT-420 CAS-PGE should fail when product ingests fail (bfoster)
* OODT-419 Make PgeConfigBuilder configuration via PgeTaskMetKeys (bfoster)
* OODT-418 Improve CAS-PGE logging (bfoster)
* OODT-71 Add lifecycle model supporting transition, done
and waiting states (mattmann)
* OODT-414 Create Java Logger Handler for CAS-PGE (bfoster)
* OODT-415 Add support to ExecUtils callProgram to take OutputStreams
for forwarding stdout and stderr (bfoster)
* OODT-249 When a node is removed from the Resource Management
system, it should be removed from all of its queues as well (gabe via mattmann)
* OODT-376 Addition of Cas-Browser Balance module (gabe)
* OODT-411 Port CAS-PGE's PcsMetadataKeys to PgeTaskMetKeys (bfoster)
* OODT-409 Convert CAS-PGE metadata keys and workflow statuses from static Strings to enums (bfoster)
* OODT-406 Add CAS-PGE support for multiple Property Adders (bfoster)
* OODT-403 Port wengine ControlMetadata to cas-pge's PgeMetadata (bfoster)
* OODT-34 Ability for File Manager to stage an ingested Product to one of its clients (bfoster)
* OODT-400 Add options for CAS-Crawler's SendNotification CrawlerAction (bfoster)
* OODT-399 cas-cli sub-option requirements for help printing was not
using p:required for GroupSubOption (bfoster)
* OODT-395 SerializableMetadata.toXml() doesn't set namespace on root element (rickdn)
* OODT-361 Workflow test event fails with NPE (rickdn)
* OODT-373 PCS OpsUI component not listed in OODT pom.xml (ahart)
* OODT-397 XmlRpcWorkflowManager tests don't properly clean up
LuceneCatalog remnants (mattmann)
* OODT-396 Add shutdown hook to the Workflow Manager server (mattmann)
* OODT-394 Integrate CAS-Protocol with CAS-CLI (bfoster)
* OODT-392 Remove old command line option code from commons (bfoster)
* OODT-391 Integrate CAS-Catalog with CAS-CLI (bfoster)
* OODT-352 Integrate CAS-CLI into CAS-Crawler (bfoster)
* OODT-389 Lucene Workflow Instance Repository index now intialized on startup (pramirez)
* OODT-382 Lucene FileManager index now intialized on startup (pramirez)
* OODT-388 Clearly indicate location for loading globally-required Balance modules (ahart)
* OODT-379 Fix CAS-CLI help option sorting and added handler initialization (bfoster)
* OODT-362 Change CmdLineAction names to match their CmdLineOption long option (bfoster)
* OODT-371 Improvements in the richness and consistency of metadata extracted from the THREDDS catalogs
in the opendap-ps module (luca)
* OODT-341 XMLPS should be able to stream large results (rickdn)
* OODT-375 Improve ApplicationResponse::includeJavascript to support including
JavaScript snippets in addition to static files (ahart)
* OODT-356 Tool to clean Workflow Instance repositories (mattmann, bfoster)
* OODT-372 Correct LDAPAuthenticationProvider class name (Shakeh Khudikyan via ahart)
* OODT-256 updateMetadata needed in XmlRpcFileManager (mattmann)
* OODT-368 Refactoring of metadata extraction functionality for
opendapps module (Luca Cinquini, mattmann)
* OODT-366 Extension to opendapps module to extract ALL variables
in DDS stream (Luca Cinquini, mattmann)
* OODT-365 Main class to drive opendapps profile generation
(Luca Cinquini, mattmann)
* OODT-367 Integrate CAS protocol into PushPull (mattmann, bfoster)
* OODT-364 Prevent XSS attacks via malformed query string (ahart)
* OODT-363 Add support for LuceneQuery action to optionally return more than
just Product ID results (bfoster)
* OODT-351 Integrate CAS-CLI into CAS-Filemgr (bfoster)
* OODT-360 Add supported for CmdLineAction detailed help description (bfoster)
* OODT-359 CmdLineUtility is not printing action messages (bfoster)
* OODT-358 Change CmdLineUtility's run(String[]) method to throw
RuntimeException when in debug mode (bfoster)
* OODT-357 Change Print Supported Actions StdCmdLinePrinter output
format to more "readable" (bfoster)
* OODT-338 XMLPS unit tests should change constructor to
setUp() (Ricky Nguyen via mattmann)
* OODT-337 XMLPSProductHandler methods should return empty lists instead
of null (Ricky Nguyen via mattmann)
* OODT-336 xmlps should omit joining of tables that are unnecessary to
fulfill query (Ricky Nguyen via mattmann)
* OODT-339 MappingReader should add default join table to DatabaseTable
if none defined (Ricky Nguyen via mattmann)
* OODT-354 CAS-CLI StdCmdLinePrinter doesn't print optional sub-options
for group options (bfoster)
* OODT-343 Add support for basic 'environment replacement' in
module config.ini files (ahart)
* OODT-353 getXmlRpcProduct and getProductFromXmlRpc should allow
null values for product member variables since Product is just
a carrier object (bfoster)
* OODT-349 CAS-CLI CmdLineAction should take a printer which
it is required to print it's messages to (bfoster)
* OODT-350 File Manager query_tool bug fix for Lucene
style queries (goodale, mattmann, bfoster)
* OODT-348 Integration CAS-Resource with CAS-CLI (bfoster)
* OODT-345 Integration CAS-Workflow with CAS-CLI (bfoster)
* OODT-344 Workflow Conditions and Timeout Seconds causes
backwards incompat SerDe issues with XML-RPC (mattmann)
* OODT-330 Factor out command line utility from oodt-commons
- check in CAS-CLI... integration to other components to come (bfoster)
* OODT-333 XMLPS query doesn't quote literal string
(Ricky Nguyen, mattmann, Sheryl John)