Entendendo esse Post

Essa blogada estava como rascunho há bastante tempo, digamos 1 ano de 2 meses para ser exato! Nesse post eu organizei minhas pesquisas e temas que definiram meu mestrado em computação pela PUC-Rio. Acho interessante compartilhar esse conteúdo porque na academia pouco de faz de concreto para divulgar amplamente "como as coisas funcionam". Muitos projetos de pesquisa se limitam a manter privados seus meios, percalços e detalhes no entorno da produção científica. Aqui eu tento listar todas as possibilidades que estiveram e ainda fazem parte do contexto do meu trabalho de mestrado.

Portanto, espero que esse conteúdo seja útil a outros que tenham interesses de pesquisa em áreas semelhantes à minha.

• A dissertação do mestrado está saindo.. assim que finalizá-la, colocarei aqui no Blog !

Deployment de Aplicações Distribuídas: Reuso das Soluções de Empacotamento e Construção de um Framework

Estudos realizados

• Deployment de componentes de software : http://www.inf.puc-rio.br/~ajunior/puc/inf2545/artigos/monografia/ (monografia + slides)
• Deployment de componentes de software (continuação) : http://www.inf.puc-rio.br/~ajunior/puc/inf2556/ (monografia + slide-monografia + slide1,2,3 com apresentação dos outros artigos)
• Soluções para empacotamento : BlogDraftPostAmadeuJunior20080714122730?
• Desenvolvimento de um protótipo usando LuaRocks como solução para empacotamento : http://www.inf.puc-rio.br/~ajunior/puc/inf2102

Deployment de Software

Processo de deployment em open-source:

• EDOS - Environment for the development and Distribution of Open Source software. The project aims to study and solve problems associated with the production, management and distribution of open source software packages: http://www.edos-project.org/xwiki/bin/view/Main/Publications

Cross-compiling para Debian:

• Cross-Compiling for Win32 - http://www.mail-archive.com/debian-embedded@lists.debian.org/msg02526.html
• Debian GNU/w32 port - http://debian-cygwin.sourceforge.net/
• Software Testing Automation Framework (STAF) - http://staf.sourceforge.net/index.php
• Vantagens de compilar programas win32 a partir do GNU/Linux: http://www.mail-archive.com/debian-embedded@lists.debian.org/msg02530.html
• Questões a entender:
  1. Entender o cgwin e mingw
  2. Quais partes são necessárias para deployment dos pacotes ?
  3. Quais dependências para portar apt/dpkg/enfim para win32 ?
  4. Existe binding do sistema de empacotamento/desempact para linguagens dinâmicas totalmente contido?
  5. Identificar quais as demandas reais/perfis de desenvolvedores da parte "cross-platform", ifndef???

Alternativas aos pacotes Debian:

• Pacman : sistema de instalação básico pensado para grids com tratamento primário de versões e dependências
• LuaRocks, RubyGems, CPAN entre outras ferramentas para instalar módulos de linguagens de programação : verificar como resolver dependências e versões
• iPKG is a very lightweight package management system - http://handhelds.org/moin/moin.cgi/Ipkg
• Soluções baseada em Debian cross-compiling que parecem tangíveis para plataformas w32 com alguma adaptação (quais??):
  • http://www.scratchbox.org/
  • http://www.scratchbox.org/documentation/user/scratchbox-1.0/html/tutorial.html
  • linked from: http://handhelds.org/moin/moin.cgi/FamiliarDistribution
• Nix 2006: The Purely Functional Software Deployment Model
  • Uma interessante dissertação onde o autor analiza algumas dificuldades e soluções simples para cross-compiling e deploy em diferentes plataformas, compatibilizando os caminhos de compilação e linkagem dinâmica.
• Zero Install:
  • What's wrong with APT? : http://0install.net/compare.html
  • ROX Desktop: http://roscidus.com/desktop/home
• LuaDist

Deployment em Sistemas Distribuídos

Artigos:

• Kung-Kiu Lau e Zheng Wang. Software Component Models. Software Engineering, IEEE Transactions on Volume 33, Issue 10, Oct. 2007.
• Distributed Service Deployment over Programmable Networks (2001) http://citeseer.ist.psu.edu/haas01distributed.html
• A Hierarchical Mechanism for the Scalable Deployment of Services over Large Programmable and Heterogeneous Networks (2001) - http://citeseer.ist.psu.edu/haas01hierarchical.html
• Component Search Service and Deployment of Distributed Applications http://doi.ieeecomputersociety.org/10.1109/DOA.2001.954078
• On Service Deployment on Peer-to-Peer Networks (2001) - http://citeseer.ist.psu.edu/535291.html
• Cross Compiling for Win32 - http://wiki.njh.eu/Cross_Compiling_for_Win32
• Fabio Kon, Jeferson Roberto Marques, Tomonori Yamane, Roy H. Campbell, and M. Dennis Mickunas. Design, Implementation, and Performance of an Automatic Configuration Service for Distributed Component Systems. In Software: Practice and Experience, 35(7), pp. 667-703, May 2005.
• Geoff Coulson, Gordon Blair, et al. A Generic Component Model for Building Systems Software. Lancaster University. ACM Transactions on Computer Systems (TOCS). Volume 26 , Issue 1, February 2008.
• Manolios, P., Vroon, D., and Subramanian, G. 2007. Automating component-based system assembly. In Proceedings of the 2007 international Symposium on Software Testing and Analysis (London, United Kingdom, July 09 - 12, 2007). ISSTA '07. ACM, New York, NY, 61-72.

Outros:

• http://www.reactos.org/en/index.html
• Infrastructure Suite aids in distributed SOA deployment http://news.thomasnet.com/fullstory/537296

Alto nível:

• Entendendo o porquê da abordagem por containers para desacoplamento: http://www.martinfowler.com/articles/injection.html

Deployment:

• OpenCCM:
  • http://openccm.objectweb.org/
  • http://openccm.objectweb.org/doc/ccm.html
  • parou? por quê?
• Fractal Component Model and Framework:
  • Trabalhos relacionados: http://ralyx.inria.fr/2006/Raweb/jacquard/uid46.html , http://ralyx.inria.fr/2006/Raweb/jacquard/uid31.html
  • Deployware - Fractal Deployment Framework : http://ralyx.inria.fr/2006/Raweb/jacquard/uid27.html
    • screenshot :
    • site : http://fdf.gforge.inria.fr/FDF/FractalDeploymentFramework
    • Areski Flissi, Jérémy Dubus, Nicolas Dolet and Philippe Merle. Deploying on the Grid with DeployWare In 8th International Symposium on Cluster Computing and the Grid (CCGRID'08), pages 177 - 184, Lyon, France, May 18--22 2008. IEEE.
• Adage:
  • http://adage.gforge.inria.fr/doku.php?id=start
  • http://adage.gforge.inria.fr/doku.php?id=doc:internals
  • http://adage.gforge.inria.fr/doku.php?id=doc:plugin_interface
  • http://www.irisa.fr/paris/bibadmin/show.php?keyword=ADAGE
• CoRDAge:
  • Author's page: http://www.irisa.fr/paris/web/Member-Home-Pages/view-12.html
  • Project page: http://cordage.gforge.inria.fr
  • Some features:
    • Proposes a uniform interface to various reservation and deployment tools
    • Offers generic and specific actions to different type of applications
    • Shares unused reserved resources among applications of a single user
    • Easy way to check for application termination
    • A very preliminary prototype has been implemented and evaluated (Voichita Almasan, master thesis 2006)
      • Handles interactions between OAR and ADAGE
• TakTuk: TakTuk is a tool for deploying parallel remote executions of commands to a potentially large set of remote nodes. It spreads itself using an adaptive algorithm and sets up an interconnection network to transport commands and perform I/Os multiplexing/demultiplexing. The TakTuk mechanics dynamically adapt to environment (machine performance and current load, network contention) by using a reactive work-stealing algorithm that mixes local parallelization and work distribution.
  • http://taktuk.gforge.inria.fr/
• DAnCE:
  • Relacionado ao CoSMIC do Schimdt : http://www.dre.vanderbilt.edu/cosmic/html/overview.shtml
  • http://www.dre.vanderbilt.edu/cosmic/html/launching.html
• OpenCOM:
  • Plastik - Managing Dynamic Reconfiguration in Component- based Systems - http://www.comp.lancs.ac.uk/~geoff/Publications/EWSA05.pdf
• Gridkit:
  • http://www.comp.lancs.ac.uk/~geoff/Publications/
  • Cai, W., Coulson, G., Grace, P., Blair, G.S., Mathy, L., Yeung, W.K., The Gridkit Distributed Resource Management Framework, Proc. European Grid Conference, Science Park Amsterdam, The Netherlands, February 14 -16 2005, published in LNCS Vol 3470, Advances in Grid Computing, ed. Sloot, Hoekstra, Priol, Reinefeld, Bubak, http://dx.doi.org/10.1007/11508380_80, pp786-796, June 2005.
  • Grace, P., Coulson, G., Blair, G., Mathy, L., Yeung, W.K., Cai, W, Duce, D., Cooper, C., GRIDKIT: Pluggable Overlay Networks for Grid Computing, Proc. Distributed Objects and Applications (DOA’04), Cyprus, Oct 2004.
• Formalização:
  • Liu, Y. D. and Smith, S. F. 2006. A formal framework for component deployment. In Proceedings of the 21st Annual ACM SIGPLAN Conference on Object-Oriented Programming Systems, Languages, and Applications (Portland, Oregon, USA, October 22 - 26, 2006). OOPSLA '06. ACM, New York, NY, 325-344
• OpenGridForum:
  • GFD.127 - Configuration Description, Deployment and Lifecycle Management Working Group (CDDLM-WG) Final Report. P. Toft, S. Loughran. 2008-03-31. Referencia:
    • Outlines the requirements for creating a deployment object responsible for the lifecycle of a deployed resource document: (GFD.65 : P-REC) [SCHAEFER06]
    • Specification of the API used to deploy and manage configured applications document: (GFD.69 : P-REC) [LOUGHRAN06]
• SmartFrog: desenvolvido pela HP para grids mas com motivação semelhante
  • http://www.smartfrog.org/
  • Fully Distributed Service Configuration Management, DSN2007 (Dependable Systems and Networks) : http://dslab.epfl.ch/hotdep/2007/paper8.pdf

Outros links:

• http://www.informatik.uni-trier.de/~ley/db/indices/a-tree/c/Cerqueira:Renato.html
• http://www.informatik.uni-trier.de/~ley/db/indices/a-tree/k/Kon:Fabio.html
• http://www.dimap.ufrn.br/~thais/Publicacoes/
• https://twiki.grid.iu.edu/twiki/bin/view/Documentation/WebHome
• Commodity Grid Toolkits: http://wiki.cogkit.org/index.php/Main_Page

Outras bibliografias:

• [Emmerich,02] Emmerich, W., Distributed Component Technologies and their Software Engineering Implications, Proc. of the 24th International Conference on Software Engineering, Orlando, Florida, pp. 537-546, 2002.
• [Jasminka,04] Jasminka Matevska-Meyer, Wilhelm Hasselbring, and Ralf H. Reussne. Software Architecture Description supporting Component Deployment and System Runtime Reconfiguration. Software Engineering Group, Department of Computing Science, University of Oldenburg, Germany.

<!-- <h4><a name="Roteiro_para_monografia"></a> Roteiro para monografia </h4> <ol> <li> contextualização (o problema) <ol> <li> deployment em sistemas distribuídos </li> <li> componentes de software </li></ol> </li> <li> relevância do problema e suas soluções <ol> <li> trabalhos relacionados <ol> <li> características </li> <li> quais partes atendem ou não </li></ol> </li></ol> </li> <li> como dizer que CCM não resolve? <ol> <li> existem implementacoes? <ol> <li> sim = openccm, completa = ??, atende = ?? </li></ol> </li> <li> elas resolvem? </li> <li> quais as características mais interessantes? </li></ol> </li> <li> como dizer que EJB (+ coisas Java) não resolve? <ol> <li> apenas java ! </li> <li> apesar de ser java, em que mais não atende? </li> <li> quais as características mais interessantes? </li></ol> </li> <li> outros modelos de componentes? <ol> <li> fractal <ol> <li> o que interessa para deployment? </li></ol> </li> <li> opencom <ol> <li> o que interessa para deployment? </li></ol> </li></ol> </li> <li> deployment de software <ol> <li> apt/dpkg </li> <li> zeroinstall </li> <li> nix packages </li> <li> como reusar? <ol> <li> language neutral ! </li> <li> como interoperar entre plataformas ? </li> <li> experiencia de plataformas embarcadas ajudam? <ol> <li> iPKG </li></ol> </li></ol> </li></ol> </li> <li> frameworks para deployment no contexto de grades <ol> <li> trabalhos relacionados <ol> <li> ADAGE, <span class="twikiNewLink">CoRDAGE<a href="http://planeta.psl-ba.softwarelivre.org/bin/edit/Blogs/CoRDAGE?topicparent=Blogs.BlogRssOneFeed" rel="nofollow" title="Create this topic">?</a></span> </li> <li> Gridkit </li> <li> Smartfrog </li></ol> </li> <li> grades oportunistas e uso de virtualização, faz sentido? </li> <li> como o deployment associado a um sistema de componentes pode ajudar? <ol> <li> caso do Integrade </li></ol> </li></ol> </li> <li> delineando um framework para deployment multi-plataforma e multi-linguagem ideal <ol> <li> faz sentido um novo framework? </li> <li> atender deployment de software </li> <li> modelo de componentes </li> <li> deployment distribuído <ol> <li> usar taktuk/kanif? </li></ol> </li> <li> abstrações para reconfiguração e adaptação </li> <li> aplicabilidade em grades computacionais </li></ol> </li></ol> -->

Paralelização de Componentes no SCS

Artigos:

• Carvalho-Junior, F. H., Lins, R. D., Corrês, R. C., Araújo, G. A., and Silva, J. C. 2007. On the design of abstract binding connectors for high performance computing component models. In Proceedings of the 2007 Symposium on Component and Framework Technology in High-Performance and Scientific Computing (Montreal, Quebec, Canada, October 21 - 22, 2007). CompFrame? '07. ACM, New York, NY, 67-76
• Wang, N., Pundaleeka, R., and Carlsson, J. 2007. Distributed component support for integrating large-scale parallel HPC applications. In Proceedings of the 2007 Symposium on Component and Framework Technology in High-Performance and Scientific Computing (Montreal, Quebec, Canada, October 21 - 22, 2007). CompFrame? '07. ACM, New York, NY, 141-150.
• Bigot, J. and Perez, C. 2007. Enabling collective communications between components. In Proceedings of the 2007 Symposium on Component and Framework Technology in High-Performance and Scientific Computing (Montreal, Quebec, Canada, October 21 - 22, 2007). CompFrame? '07. ACM, New York, NY, 121-130.
• Bernholdt, D. E. 2007. Component architectures in the next generation of ultrascale scientific computing: challenges and opportunities. In Proceedings of the 2007 Symposium on Component and Framework Technology in High-Performance and Scientific Computing (Montreal, Quebec, Canada, October 21 - 22, 2007). CompFrame? '07. ACM, New York, NY, 1-10.

Dicas de LaTeX

• http://en.wikibooks.org/wiki/LaTeX/Algorithms_and_Pseudocode

Coisas Win32

• Serviços Win32 para compatibilidade POSIX : http://en.wikipedia.org/wiki/Microsoft_Windows_Services_for_UNIX