Email this article Data Engineering on Azure: RC Morgan
Abstract
In order to transfer huge amount of data we need cloud computing. Microsoft Azure is one of the cloud computing platforms. The Azure data engineers combine, convert, and consolidate data from a variety of structured and unstructured data sources to improve structures that can be used to produce analytics solutions. In this paper, we'll demonstrate how to validate incoming data in the Azure Data Lake storage account and, by using Azure Databricks Notebook, we'll write some rules of validation and secure it by using a key vault.
Keywords
References
K. Gupta, N. Jiwani and N. Afreen, "Blood Pressure Detection Using CNN-LSTM Model," 2022 IEEE 11th International Conference on Communication Systems and Network Technologies (CSNT), 2022, pp. 262-366.
N. Jiwani, K. Gupta and N. Afreen, "A Convolutional Neural Network Approach for Diabetic Retinopathy Classification," 2022 IEEE 11th International Conference on Communication Systems and Network Technologies (CSNT), 2022, pp. 357-361.
P. Whig, R. R. Nadikattu, and A. Velu, “COVID-19 pandemic analysis using application of AI,” Healthcare Monitoring and Data Analysis Using IoT: Technologies and Applications, p. 1, 2022.
M. Anand, A. Velu, and P. Whig, “Prediction of Loan Behaviour with Machine Learning Models for Secure Banking,” Journal of Computer Science and Engineering (JCSE), vol. 3, no. 1, pp. 1–13, 2022.
Y. Alkali, I. Routray, and P. Whig, “Study of various methods for reliable, efficient and Secured IoT using Artificial Intelligence,” Available at SSRN 4020364, 2022.
G. Chopra and P. WHIG, “A clustering approach based on support vectors,” International Journal of Machine Learning for Sustainable Development, vol. 4, no. 1, pp. 21–30, 2022.
G. Chopra and P. Whig, “Smart Agriculture System Using AI,” International Journal of Sustainable Development in Computing Science, vol. 1, no. 1, 2022.
M. Madhu and P. WHIG, “A survey of machine learning and its applications,” International Journal of Machine Learning for Sustainable Development, vol. 4, no. 1, pp. 11–20, 2022.
G. Chopra and P. Whig, “Energy Efficient Scheduling for Internet of Vehicles,” International Journal of Sustainable Development in Computing Science, vol. 4, no. 1, 2022.
G. Chopra and P. WHIG, “Using machine learning algorithms classified depressed patients and normal people,” International Journal of Machine Learning for Sustainable Development, vol. 4, no. 1, pp. 31–40, 2022.
P. WHIG, “More on Convolution Neural Network CNN,” International Journal of Sustainable Development in Computing Science, vol. 1, no. 1, 2022.
P. Whig, “IoT Based Novel Smart Blind Guidance System,” Journal of Computer Science and Engineering (JCSE), vol. 2, no. 2, pp. 80–88, 2021.
G. Chopra and P. Whig, “Analysis of Tomato Leaf Disease Identification Techniques,” Journal of Computer Science and Engineering (JCSE), vol. 2, no. 2, pp. 98–103, 2021.
A. Velu and P. Whig, “Studying the Impact of the COVID Vaccination on the World Using Data Analytics”.
P. Asopa, P. Purohit, R. R. Nadikattu, and P. Whig, “Reducing carbon footprint for sustainable development of smart cities using IoT,” in 2021 Third International Conference on Intelligent Communication Technologies and Virtual Mobile Networks (ICICV), 2021, pp. 361–367.
P. Whig, “Artificial intelligence and machine learning in business,” Engineering Reports, vol. 2, no. 2, pp. 8–13, 2019.
Dr. P. W. and S. N. Ahmad, “NEURAL NETWORK AND FUZZY SYSTEM,” EJRD - International Multidisciplinary Journal, vol. 2, no. 6, p. 8, 2017.
P. Ajay Rupani, “The development of big data science to the world,” Engineering Reports, vol. 2, no. 2, pp. 1–7, 2019.
A. Rupani and D. Kumar, “Temperature Effect On Behaviour of Photo Catalytic Sensor (PCS) Used For Water Quality Monitoring,” 2020.
K. K. and P. Whig2*, “Macroeconomic Implications of the Monetary Policy Committee Recommendations: An IS-LM Framework,” ACTA SCIENTIFIC AGRICULTURE (ISSN: 2581-365X), vol. 4, no. 2, 2020.
P. Whig, “Novel PCS Output Calibration Technique,” Available at SSRN 3621365, 2020.
R. R. Nadikattu, S. M. Mohammad, and P. Whig, “Novel economical social distancing smart device for covid-19,” International Journal of Electrical Engineering and Technology (IJEET), 2020.
N. Jiwani, K. Gupta and P. Whig, "Novel HealthCare Framework for Cardiac Arrest With the Application of AI Using ANN," 2021 5th International Conference on Information Systems and Computer Networks (ISCON), 2021, pp. 1-5.
K. Gupta, N. Jiwani, N. Afreen and D. D, "Liver Disease Prediction using Machine learning Classification Techniques," 2022 IEEE 11th International Conference on Communication Systems and Network Technologies (CSNT), 2022, pp. 221-226.
Refbacks
- There are currently no refbacks.
Copyright (c) 2022 International Journal of Sustainable Development in Computing Science
This work is licensed under a Creative Commons Attribution-NonCommercial-NoDerivatives 4.0 International License.
A Double-Blind Peer Reviewed Journal