An Android-Based Multimodal AI Application for Contextual Environmental Learning in Children
DOI:
https://doi.org/10.47738/ijiis.v8i3.264Keywords:
Artificial Intelligence, Multimodal Learning, Google Gemini, Contextual Learning, Environmental Education, Android Application, ChildrenAbstract
Children’s limited engagement with nature in the digital era poses a growing challenge for environmental education. This study presents the development of an Android-based educational application that leverages multimodal artificial intelligence (AI)—specifically the Google Gemini model—to facilitate contextual environmental learning for preschool and elementary-aged children. Using a prototyping methodology, the application integrates image capture, cloud-based processing through a FastAPI backend, and a Flutter-based interface designed for young learners. The system allows children to photograph plants and receive real-time, age-appropriate explanations about plant names, characteristics, and ecological functions in a narrative format. A limited usability trial involving children of varying age groups demonstrated positive engagement and curiosity, indicating the app’s potential as an interactive and enjoyable learning medium. Despite occasional inaccuracies in AI-generated descriptions and reliance on internet connectivity, user feedback suggested strong interest and educational value. Future enhancements will focus on developing localized plant databases, improving accuracy, and incorporating gamification elements. Overall, this study contributes to the growing field of AI-driven educational technology, demonstrating how multimodal AI can effectively bridge digital learning with real-world environmental experiences.References
J. Li, U. Agvaantseren, and L. Qin, “The Current Status and Influencing Factors of Digital Product Use Among Young Children in the Digital Age,” J. Ecohumanism, vol. 3, no. 8, pp. 3659–3674, 2024, doi: 10.62754/joe.v3i8.5031.
K. Narang, J. S. Thakur, K. Das, A. Garg, and T. Narang, “Effect of COVID-19 Pandemic on Physical Activity and Screen Time of School Children: A Cross-sectional Study from Chandigarh,” Nurs. Midwifery Res. J., vol. 20, no. 1, pp. 51–57, 2024, doi: 10.1177/0974150x241230746.
J. Prins, “Nature play in early childhood leads to great and varied language production,” pp. 1–16, 2024.
T. Dilnura, “Teaching To Love Nature: Environmental Lessons for Preschool-Aged Children,” Int. J. Adv. Sci. Res., vol. 05, no. 12, pp. 81–86, 2024, doi: 10.37547/ijasr-04-12-14.
S. Y. Smirnova and E. E. Klopotova, “Children’s interaction with digital devices: an overview of research and recommendations,” J. Mod. Foreign Psychol., vol. 12, no. 4, pp. 91–100, 2024, doi: 10.17759/jmfp.2023120408.
B. Astriana, M. Jalaludin, and I. Muliati, “Dampak Psikologis Penggunaan Gadget Berlebihan pada Anak,” J. Adv. Learn. Media Dev., vol. 1, no. 1, pp. 1–6, 2024, doi: 10.37396/jalmd.v1i1.1.
M. Imran and N. Almusharraf, “Google Gemini as a next generation AI educational tool: a review of emerging educational technology,” Smart Learn. Environ., vol. 11, no. 1, 2024, doi: 10.1186/s40561-024-00310-z.
I. mutiawati Ida mutiawati, “Konsep Dan Implementasi Pendekatan Kontekstual Dalam Proses Pembelajaran,” J. Mudarrisuna Media Kaji. Pendidik. Agama Islam, vol. 13, no. 1, p. 80, 2023, doi: 10.22373/jm.v13i1.18099.
R. Fauzi et al., “CREATING IMMERSIVE LEARNING EXPERIENCES WITH AI :,” vol. 5, no. 2, pp. 104–109, 2024.
A. Bewersdorff et al., “Taking the Next Step with Generative Artificial Intelligence: The Transformative Role of Multimodal Large Language Models in Science Education,” pp. 1–21, 2024, doi: 10.1016/j.lindif.2024.102601.
B. Alsanousi, A. S. Albesher, H. Do, and S. Ludi, “Investigating the User Experience and Evaluating Usability Issues in AI-Enabled Learning Mobile Apps: An Analysis of User Reviews,” Int. J. Adv. Comput. Sci. Appl., vol. 14, no. 6, pp. 18–29, 2023, doi: 10.14569/IJACSA.2023.0140602.
A. Namoun et al., “Generative artificial intelligence in education: an umbrella review of applications and challenges,” pp. 0–36, 2024.
J. Xiao and Z. Zhang, “EduVQA: A multimodal Visual Question Answering framework for smart education,” Alexandria Eng. J., vol. 122, no. January, pp. 615–624, 2025, doi: 10.1016/j.aej.2025.03.005.
E. Sun and L. Tai, “MultiTutor : Collaborative LLM Agents for Multimodal Student Support,” no. 2022, pp. 1–17, 2025.
K. Palshkov, N. Shetelya, N. Khlus, I. Vakulyk, and I. Khyzhniak, “Impact of mobile apps in higher education: Evidence on learning,” Rev. Amaz. Investig., vol. 13, no. 74, pp. 115–128, 2024, doi: 10.34069/ai/2024.74.02.10.
N. M. Coelho, M. M. C. Cunha, and P. S. Ávila, “Application of the Industry 4.0 Technologies to Mobile Learning and Health Education Apps,” FME Trans., vol. 49, no. 4, pp. 876–885, 2021, doi: 10.5937/FME2104876M.
E. Du Bois and I. Horváth, “Abstract prototyping in software engineering: A review of approaches,” ICED 11 - 18th Int. Conf. Eng. Des. - Impacting Soc. Through Eng. Des., vol. 10, no. PART 2, pp. 258–269, 2011.
T. S. Jones and R. C. Richey, “Rapid prototyping methodology in action: A developmental study,” Educ. Technol. Res. Dev., vol. 48, no. 2, pp. 63–80, 2000, doi: 10.1007/BF02313401.
S. A. Nugroho, A. P. Hadi, R. Rudjiono, and A. Zainudin, “Aplikasi Mobile Learning Pembelajaran Video Editing Berbasis Android Pada Persatuan Pemuda Sandya Karya Muda Desa Reksosari Kec Suruh Kabupaten Semarang,” Pixel J. Ilm. Komput. Graf., vol. 15, no. 1, pp. 196–205, 2022, doi: 10.51903/pixel.v15i1.765.
A. Obaid, “Using Prototypes in Agile Software Development,” Int. J. Comput. Informatics, vol. 3, no. 2, pp. 23–38, 2024, doi: 10.59992/ijci.2024.v3n2p2.
Rahmat Maulana, Richi Andrianto, Akhyar Nasution, Hanif Ahmad Hasibuan, Ari Rahmad Rahmad Siregar, and Alfian Hasonangan Hasibuan, “Penerapan Flutter Dalam Pengembangan Aplikasi Mobile Resep Kue Indonesia,” J. Penelit. Teknol. Inf. dan Sains, vol. 1, no. 3, pp. 103–110, 2023, doi: 10.54066/jptis.v1i3.819.
K. chiu Wu, Y. meng Tang, and C. yu Tsai, “Graphical interface design for children seeking information in a digital library,” Vis. Eng., vol. 2, no. 1, pp. 1–14, 2014, doi: 10.1186/2213-7459-2-5.
M. T. Nayeem and D. Rafiei, “KidLM: Advancing Language Models for Children - Early Insights and Future Directions,” EMNLP 2024 - 2024 Conf. Empir. Methods Nat. Lang. Process. Proc. Conf., pp. 4813–4836, 2024.
Downloads
Published
Issue
Section
License
Authors who publish with IJIIS : International Journal on Informatics and Information Systems agree to the following terms: Authors retain copyright and grant the IJIIS : International Journal on Informatics and Information Systems right of first publication with the work simultaneously licensed under a Creative Commons Attribution License (CC BY-SA 4.0) that allows others to share (copy and redistribute the material in any medium or format) and adapt (remix, transform, and build upon the material) the work for any purpose, even commercially with an acknowledgement of the work's authorship and initial publication in IJIIS : International Journal on Informatics and Information Systems. Authors are able to enter into separate, additional contractual arrangements for the non-exclusive distribution of the journal's published version of the work (e.g., post it to an institutional repository or publish it in a book), with an acknowledgement of its initial publication in IJIIS : International Journal on Informatics and Information Systems. Authors are permitted and encouraged to post their work online (e.g., in institutional repositories or on their website) prior to and during the submission process, as it can lead to productive exchanges, as well as earlier and greater citation of published work (See The Effect of Open Access).
