Project

General

Profile

Edit History

2014-04-16 Dev tools and dataresource management » History » Version 1

Anonymous, 04/14/2014 03:48 PM

1 1 
h1. 2014-04-16 Dev tools and data/resource management
2 





    3
    
    
    
h1. Arvados Private Wiki





    4
    
    
    





    5
    
    
    
This wiki is internal to Curoverse, Inc.





    6
    
    
    





    7
    
    
    
h2. Development Process and Tools 





    8
    
    
    





    9
    
    
    
* [[Summary of Development Process]]





    10
    
    
    
* [[DevOps To Do List]]





    11
    
    
    
* [[Release Roadmap]]





    12
    
    
    
* [[Sprint Retrospectives]]





    13
    
    
    
* [[Gem and Pypi publishing instructions]]





    14
    
    
    
* [[Hacking API server]]





    15
    
    
    
* [[Hacking Workbench]]





    16
    
    
    
* [[Redmine wishlist]]





    17
    
    
    





    18
    
    
    
h2. Operations





    19
    
    
    





    20
    
    
    
* [[4xphq]] private beta instance





    21
    
    
    
* [[Deploying a new Arvados instance]]





    22
    
    
    
* [[Updating an Arvados instance]]





    23
    
    
    
* [[Running tests]]





    24
    
    
    
* [[Tech FAQ]]





    25
    
    
    
* [[Distributing encrypted disks]]





    26
    
    
    
* [[Cluster install instructions]]





    27
    
    
    
* [[Deploy instructions]] -- installing and updating Arvados API server and Workbench on production systems





    28
    
    
    
* [[New PaaS user activation]]





    29
    
    
    
* [[Setting up a private VM for a user]]





    30
    
    
    
* [[gps:Amazon setup and notes]] (in GPS project)





    31
    
    
    





    32
    
    
    
h2. System/component designs and specifications





    33
    
    
    





    34
    
    
    
* [[Functional components]] and where they live in the source tree





    35
    
    
    





    36
    
    
    
h3. Keep





    37
    
    
    





    38
    
    
    
* public [[arvados:Keep server]] specification @ Arvados





    39
    
    
    
* public [[arvados:Keep index]] design in progress @ Arvados





    40
    
    
    
* public [[arvados:Keep manifest format]] specification @ Arvados





    41
    
    
    
* [[Keep Specification]] describes current Perl prototype





    42
    
    
    
* [[Next generation keep]]





    43
    
    
    
* [[Using Keep with S3 backing store]]





    44
    
    
    
* [[Keep federation]]





    45
    
    
    





    46
    
    
    
h3. Other infrastructure





    47
    
    
    





    48
    
    
    
* [[Crunch]]





    49
    
    
    
* [[Event bus]]





    50
    
    
    
* [[Logging facility]]





    51
    
    
    
* [[Metadata database]]





    52
    
    
    
* [[EC2 compute node life cycle]]





    53
    
    
    





    54
    
    
    
h3. User interface





    55
    
    
    





    56
    
    
    
* [[Workbench UI design]]





    57
    
    
    
** [[Presenting a set of jobs]]





    58
    
    
    





    59
    
    
    
h3. Accounts and permissions





    60
    
    
    





    61
    
    
    
* [[User activation states]]





    62
    
    
    
* [[Permissions model]]





    63
    
    
    
* [[Terms of Service mechanism]]





    64
    
    
    
* [[Pre-activation mechanism]]





    65
    
    
    





    66
    
    
    
h2. Research notes - related projects





    67
    
    
    





    68
    
    
    
* [[Alternative cluster storage systems]]





    69
    
    
    
* [[Alternative MapReduce and cluster scheduling systems]]





    70
    
    
    
* [[Remote Procedure Call systems]]





    71
    
    
    
* [[Metadata database]]





    72
    
    
    
* [[Openstack Notes]]





    73
    
    
    
* [[Message bus]]





    74
    
    
    
* [[Galaxy]]





    75
    
    
    





    76
    
    
    
h2. Data curation references





    77
    
    
    





    78
    
    
    
* [[Copying PGP data to AWS]]





    79
    
    
    
* [[Importing PGP survey data to Arvados]]





    80
    
    
    





    81
    
    
    
h2. Admin references





    82
    
    
    





    83
    
    
    
h2. Introductory material for people new to Curoverse/Arvados





    84
    
    
    





    85
    
    
    
* [[Background Reading]]





    86
    
    
    





    87
    
    
    
h2. Customer Development





    88
    
    
    





    89
    
    
    
Materials such as a user personas, business strategy information, and notes on customer visits are stored in "Google Drive":https://drive.google.com (and other places?).





    90
    
    
    





    91
    
    
    
h2. Archives





    92
    
    
    





    93
    
    
    
These are pages that are no longer active or relevant 





    94
    
    
    





    95
    
    
    
* [[Release 1]]





    96
    
    
    
* [[Meeting notes]]





    97
    
    
    
* [[API]]





    98
    
    
    
* [[Permission model]]





    99
    
    
    
* [[Source tree overview]]





    100
    
    
    
* [[Demo 2013-02-05]]





    101
    
    
    
* [[Project status]]





    102
    
    
    
* [[Ruby client quick start]]





    103
    
    
    
* [[Command line examples]]





    104
    
    
    
* [[Admin and system API examples]]





    105
    
    
    
* [[Explorvos]] sample API client, orvos-explorer





    106
    
    
    
* [[Admin Interface]] (from Orvos days)





    107
    
    
    
* [[Orvos-server install and bootstrap]]





    108
    
    
    
* [[Compute node setup]]





    109
    
    
    
* [[Underlying technical decisions]]