UIJRT » United International Journal for Research & Technology

Platform Migration: Data Centers to Cloud Architectures

Total Views / Downloads: 83 

Cite ➜

Atreyas, P.V., Yamuna, S., Khadse, P. and Prapulla, S.B., 2021. Platform Migration: Data Centers to Cloud Architectures. United International Journal for Research & Technology (UIJRT), 2(8), pp.93-97.

Abstract

With the current trend where organizations are moving towards cloud services and hybrid cloud technologies, the objective of this study is to develop a seamless data pipeline to perform data integration as part of platform migration, i.e. from data centers to cloud architecture. The proposed methodology is to implement these jobs by employing the Extract-Transform-Load (ETL) procedures to develop interfaces in Talend Open Studio, viz., a data integration tool. First, the data is extracted from multiple sources, such as, databases and flat files. Then, multiple transformations such as filtering, sorting and joining are done on the data. Finally, the transformed data is loaded into the staging tables of the Enterprise Data Warehouse. This is achieved by migrating the interfaces from the tool currently in use, IBM Infosphere DataStage, to re-create the functionalities. The comparison between the features of the two tools, Talend and DataStage, resulted in the identification of the pros and cons of each tool. It was inferred that Talend is equivalent to DataStage in most of the cases but with enhancements and tweaks in Talend, the execution time of few interfaces were reduced by half.

Keywords: Talend, DataStage, Cloud migration, Data integration, ETL.

References

  1. Duncan Stewart, Nobuo Okubo, “The cloud migration forecast: Cloudy with a chance of clouds. TMT Predictions 2021”, 07 Dec, 2020, Accessed on 11 May, 2021, [Online] Available: https://www2.deloitte.com/xe/en/insights/industry/technology/technology-media-and-telecom-predictions/2021/cloud-migration-trends-and-forecast.html.
  2. Anurag, “Everything you need to know about Platform Migration”, 7 May, 2020. Accessed on 11 May, 2021, [Online] Available: https://www.newgenapps.com/blog/everything-you-need-to-know-about-platform-migration/.
  3. S. Linthicum, “Cloud-Native Applications and Cloud Migration: The Good, the Bad, and the Points Between,” in IEEE Cloud Computing, vol. 4, no. 5, pp. 12-14, September/October 2017, doi: 10.1109/MCC.2017.4250932.
  4. Yifat Perry. “Cloud MigrationWhat Is a Lift and Shift Cloud Migration?”. 7 Mar, 2020. Accessed on 11 May, 2021 [Online] Available: https://cloud.netapp.com/blog/what-is-a-lift-and-shift-cloud-migration.
  5. Jamshidi, A. Ahmad and C. Pahl, “Cloud Migration Research: A Systematic Review,” in IEEE Transactions on Cloud Computing, vol. 1, no. 2, pp. 142-157, July-December 2013, doi: 10.1109/TCC.2013.10.
  6. S. Diouf, A. Boly and S. Ndiaye, “Variety of data in the ETL processes in the cloud: State of the art,” 2018 IEEE International Conference on Innovative Research and Development (ICIRD), 2018, pp. 1-5, doi: 10.1109/ICIRD.2018.8376308.
  7. Kandil and H. El-Deeb, “Exploration of application migration to cloud environment,” 2016 6th International Conference – Cloud System and Big Data Engineering (Confluence), 2016, pp. 109-114, doi: 10.1109/CONFLUENCE.2016.7508097.
  8. Rongen, “Making the case for migration of information systems to the cloud”, 16thTwente Student Conference on IT, Enschede, The Netherlands, 2012.
  9. Meng, J. Shi, X. Liu, H. Liu and L. Wang, “Legacy Application Migration to Cloud,” 2011 IEEE 4th International Conference on Cloud Computing, 2011, pp. 750-751, doi: 10.1109/CLOUD.2011.56.
  10. Shrinivasan, C, “Data Migration from a Product to a Data Warehouse Using ETL Tool”, Proceedings of the Euromicro Conference on Software Maintenance and Reengineering, CSMR, 2010, pp 63 – 65, doi: 10.1109/CSMR.2010.25.
  11. Sreemathy, I. Joseph V., S. Nisha, C. Prabha I. and G. Priya R.M., “Data Integration in ETL Using TALEND,” 6th International Conference on Advanced Computing and Communication Systems (ICACCS), Coimbatore, India, 2020, pp. 1444-1448, doi: 10.1109/ICACCS48705.2020.9074186.
  12. A. Chauhan and M. A. Babar, “Migrating Service-Oriented System to Cloud Computing: An Experience Report,” 2011 IEEE 4th International Conference on Cloud Computing, 2011, pp. 404-411, doi: 10.1109/CLOUD.2011.46.
  13. Ali, Syed Muhammad Fawad, “Next-generation ETL Framework to Address the Challenges Posed by Big Data.”, DOLAP, 2018
  14. Munoz, J. Mazon and J. Trujillo, “ETL Process Modeling Conceptual for Data Warehouses: A Systematic Mapping Study,” in IEEE Latin America Transactions, vol. 9, no. 3, pp. 358-363, June 2011, doi: 10.1109/TLA.2011.5893784
  15. Bansel, H. González-Vélez and A. E. Chis, “Cloud-Based NoSQL Data Migration,” 2016 24th Euromicro International Conference on Parallel, Distributed, and Network-Based Processing (PDP), 2016, pp. 224-231, doi: 10.1109/PDP.2016.111.

For Conference & Paper Publication​

UIJRT Publication - International Journal