Acessibilidade / Reportar erro

Decoding Deep Learning applications for diagnosis and treatment planning

ABSTRACT

Introduction:

Artificial Intelligence (AI), Machine Learning and Deep Learning are playing an increasingly significant role in the medical field in the 21st century. These recent technologies are based on the concept of creating machines that have the potential to function as a human brain. It necessitates the gathering of large quantity of data to be processed. Once processed with AI machines, these data have the potential to streamline and improve the capabilities of the medical field in diagnosis and treatment planning, as well as in the prediction and recognition of diseases. These concepts are new to Orthodontics and are currently limited to image processing and pattern recognition.

Objective:

This article exposes and describes the different methods by which orthodontics may benefit from a more widespread adoption of these technologies.

Keywords:
Deep learning; Artificial intelligence; Orthodontics

RESUMO

Introdução:

Inteligência Artificial (AI, de Artificial Intelligence), Machine Learning (Aprendizado de máquinas) e Deep Learning (Aprendizado Profundo) possuem um papel significativo e crescente na área médica do século 21. Essas tecnologias recentes são baseadas no conceito de criar máquinas com potencial de funcionar como um cérebro humano. Isso demanda que uma grande quantidade de dados seja reunida para ser processada. Uma vez processados em máquinas com AI, esses dados têm o potencial de agilizar e potencializar as capacidades de diagnóstico e planejamento do tratamento nas áreas médicas, assim como no diagnóstico e prognóstico de doenças. Esses são conceitos novos na Ortodontia, que atualmente são subutilizados, limitando-se ao processamento de imagens e reconhecimento de padrões.

Objetivo:

O presente artigo expõe e descreve os diferentes métodos pelos quais os ortodontistas podem se beneficiar com o uso mais abrangente dessas tecnologias.

Palavras-chave:
Aprendizado profundo; Inteligência artificial; Ortodontia

INTRODUCTION

Two major trends are influencing the 21st Century from business and life perspectives. Society has entered a data-driven world where the interactions between machine and humans are intertwined. The importance of artificial and augmented intelligence in our daily lives is becoming increasingly prevalent.11 Ntoutsi E, Fafalios P, Gadiraju U, Iosifidis V, Nejdl W, Vidal ME, et al. Bias in data-driven artificial intelligence systems-an introductory survey. WIREs Data Mining Knowl Discov. 2020;10:e1356. Orthodontics, the most technologically-oriented dental specialty is rapidly adopting these technologies for diagnosis, treatment planning and management of complex malocclusions.22 Alhashmi SF, Alshurideh M, Kurdi BA, Salloum SA. A systematic review of the factors affecting the artificial intelligence implementation in the health care sector. In: AICV 2020: Proceedings of the International Conference on Artificial Intelligence and Computer Vision (AICV2020). Springer; 2020.

3 He J, Baxter SL, Xu J, Xu J, Zhou X, Zhang K. The practical implementation of artificial intelligence technologies in medicine. Nat Med. 2019;25(1):30-6.
-44 Gandedkar NH, Vaid NR, Darendeliler MA, Premjani P, Ferguson DJ, editors. The last decade in orthodontics: a scoping review of the hits, misses and the near misses! Semin Orthod. 2019;25(4):339-55.

The development of super computers followed by hypercomputers in the 1990s has allowed large quantity of data to be processed at an extremely rapid rate.55 Dreyer KJ, Hirschhorn D, Thrall JH, PACS M. A guide to the digital revolution. New York: Springer; 2006. The Artificial Intelligence (AI) field has consequently evolved into machine learning (ML) and deep learning (DL), where computers learn tasks that human are unable to accomplish.

The field of Orthodontics, with its reliance on 3D data and based heavily on diagnostics and interpretation of large quantity of data from different sources, is particularly well suited to the use of AI and DL.66 Chung HM, Gray P. Data mining. J Manage Inf Syst. 1999;16(1):11-6.,77 Leonardi R, Giudice AL, Isola G, Spampinato C. Deep learning and computer vision: two promising pillars, powering the future in orthodontics. Semin Orthod. 2021;27(1)2021.

WHAT IS ARTIFICIAL INTELLIGENCE? THE “EARLY DAYS”

Dr. Rosenblatt introduced the Perceptron in 1953 and the term “artificial intelligence” first appeared at a conference in 1956.88 Rosenblatt F. The perceptron: a probabilistic model for information storage and organization in the brain. Psychol Rev. 1958;65(6):386. AI is a large field of computer science where machines learn and interact with human using logical processes based on data.99 Aggarwal CC. Neural networks and deep learning. New York: Springer; 2018. The concept was to create computers that mimicked human thought process. The Perceptron, or “artificial neuron“, is a linear binary classifier (e.g., yes-no) and is considered the origin of AI (Fig 1).

Figure 1:
Perceptron, or “artificial neuron”. From left to right: The input layer is used to import the data into the system. The weight (W) are values from 0 to 1 attributed to the input. The Sum Σ is given by the addition of the input multiplied by their respective weights. An activation function is then used to obtain the output.

ARCHITECTURE OF THE MULTILAYER PERCEPTRON AND OF A SIMPLE NEURAL NETWORK1010 Mezard M, Nadal J-P. Learning in feedforward layered networks: the tiling algorithm. J Phys., A, Math Gen. 1989;22(12):2191.

  1. Input initial dataset labeled: Each datapoint is entered, such as overbite, overjet, crowding in Orthodontics.

  2. Artificial neuron or unit: Is created to mimic a human neuron and consists of a mathematical function (y = ax +b, as an example), ‘x’ being the inputs, ‘y’ being the output.

  3. Layer: The layer consists of a group of artificial neurons placed in a vertical pattern of artificial neurons. Each vertical line of neuron is driven by a specific function.

  4. Weights and biases define the strength or importance of the connection of one input to the next input layer. They are adjustable either by the trainer or by multiple iterations in the cycle of learning.

  5. Activation function: Mathematical function that helps the network learn by calculating the relative influence of a given artificial neuron on the next layer. These functions are made possible by applying different mathematical algorithms called activation functions, transforming the sum of inputs into outputs.

  6. Input layer is the first layer of a neural network. It brings the data gathered into the network, which will be assigned a weight and moved to the next layers. The data can be labelled (organized) or unlabeled (not organized).

  7. Hidden layers: The layers that are located between the input layer and the output layer. There may be one or many hidden layers, and each layer acts independently from its predecessor or successor, as they use a different activation function.1111 Gardner MW, Dorling S. Artificial neural networks (the multilayer perceptron)-a review of applications in the atmospheric sciences. Atmos Environ. 1998;32(14-15):2627-36.

  8. Output layer represents the final layer. Probable output is the prediction given by the output layer and expressed in terms that are understandable to the user.

Several definitions and subsections of AI have been described: Machine learning, deep learning and reinforcement learning are common terms that are oftentimes used interchangeably, but represent different types of AI.1212 Helm JM, Swiergosz AM, Haeberle HS, Karnuta JM, Schaffer JL, Krebs VE, et al. Machine learning and artificial intelligence: definitions, applications, and future directions. Curr Rev Musculoskelet Med. 2020;13:69-76.

Machine learning is based on the concept of narrow AI, which is a form of AI programmed by human to perform a specialized task.1313 Bundy A. Preparing for the future of artificial intelligence. AI & Society. 2017;32(2):285-287.,1414 Mohammad-Rahimi H, Nadimi M, Rohban MH, Shamsoddin E, Lee VY, Motamedian SR. Machine learning and orthodontics, current trends and the future opportunities: a scoping review. Am J Orthod Dentofacial Orthop. 2021;160(2):170-92.e4. An example is the pursuit of a specific medical diagnosis, where the machine is trained to recognize and classify different signs and symptoms to obtain a probable diagnosis.1515 Kononenko I. Machine learning for medical diagnosis: history, state of the art and perspective. Artif Intell Med. 2001;23(1):89-109.,1616 Khanagar SB, Al-Ehaideb A, Vishwanathaiah S, Maganur PC, Patil S, Naik S, et al. Scope and performance of artificial intelligence technology in orthodontic diagnosis, treatment planning, and clinical decision-making-A systematic review. J Dent Sc. 2021;16(1):482-92. Machine learning can be used for several important functions in Orthodontics: descriptive, predictive, and prescriptive.1717 Mesko B. The role of artificial intelligence in precision medicine. Expert Review of Precision Medicine and Drug Development. 2017;2(5):239-241.,1818 Akdeniz S, Tosun ME. A review of the use of artificial intelligence in orthodontics. J Exp Clin Med. 2021;38(S2):157-62. Descriptive functions in Orthodontics can be linked to the formulation of a diagnosis when the different parameters (inputs) are considered1919 Rousseau M, Retrouvey J-M. pfla: a python package for dental facial analysis using computer vision and statistical shape analysis. J Open Source Softw. 2018;3(32):855.. Predictive, as its name implies, is meant to predict the most accurate outcome of a potential treatment - in Orthodontics, it could be the decision to extract or not extract.2020 Tanikawa C, Yamashiro T. Development of novel artificial intelligence systems to predict facial morphology after orthognathic surgery and orthodontic treatment in Japanese patients. Sci Rep. 2021;11:15853. Prescriptive functions could be linked to the choice of the most appropriate appliance or biomechanical system to address a given malocclusion.

Another subset of AI is deep learning, which uses several types of neural networks that learn using unlabeled dataset, without being directly supervised by humans.2121 LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015;521(7553):436-44.,2222 Pennachin C, Goertzel B. Artificial general intelligence. Heidelberg: Springer; 2007. Deep neural networks consist of multiple hidden layers that imitate the cognitive and reasoning abilities of the human brain, to eventually provide general intelligence, which is the closest to human intelligence.2323 Cheng B, Titterington DM. Neural networks: a review from a statistical perspective. Statist Sci. 1994;(1):2-30.,2424 Pennachin C, Goertzel B. Contemporary approaches to artificial general intelligence. In: Artificial general intelligence: Heidelberg: Springer; 2007. p. 1-30. These networks became relevant in the early 2000s with the advent of more advanced Graphic Processing Units (Nvidia™, 1999) and the creation of very large datasets (Big Data).99 Aggarwal CC. Neural networks and deep learning. New York: Springer; 2018.,2525 Alpaydin E. Introduction to machine learning. Cambridge: MIT press; 2009.,2626 Caruana R, Niculescu-Mizil A, editors. An empirical comparison of supervised learning algorithms. In: Proceedings of the 23rd international conference on Machine learning. Pittsburgh: Association for Computing Machinery; 2006.

ARCHITECTURE OF A NEURAL NETWORK (FIG 2)

How do neural networks “learn”?

Why is it important for the clinician?

The premise and promise of any neural network are to analyze data (inputs) through activation functions and multiple neural layers, to produce an output, which can be data classification, regression or prediction, depending on the activation functions applied.2727 Hackenberger BK. Bayes or not Bayes, is this the question? Croat Med J. 2019;60(1):50-2.

28 Lee J-H, Han S-S, Kim YH, Lee C, Kim I. Application of a fully deep convolutional neural network to the automation of tooth segmentation on panoramic radiographs. Oral Surg Oral Med Oral Pathol Oral Radiol. 2020;129(6):635-42.

29 Marr B. Big data: using smart big data, analytics and metrics to make better decisions and improve performance. Chichester: John Wiley & Sons; 2015.
-3030 Martin-Sanchez F, Verspoor K. Big data in medicine is driving big changes. Yearb Med Inform. 2014;9(1):14-20.

To create an efficient neural network or model, one must start with data mining and data management.66 Chung HM, Gray P. Data mining. J Manage Inf Syst. 1999;16(1):11-6.,3131 Koh HC, Tan G. Data mining applications in healthcare. J Healthc Inf Manag. 2005;19(2):64-72. The data gathering process involves multiple steps, and is a lengthy procedure.3232 Hand DJ. Principles of data mining. Drug Saf. 2007;30(7):621-2. The first step requires obtaining consistent high-quality data, through correct and optimized methods. The second step is to process, categorize, and classify the data. The third step is to “clean” and structure the data, to optimize it and to avoid issues with future processing.3333 Gullo F. From patterns in data to knowledge discovery: what data mining can do. Phys Procedia. 2015;62:18-22. Once this process is complete, the “clean/optimized” data is now ready to be used for AI processing. Unfortunately, in Orthodontics, there is no centralized data repository or data analysis software readily available, which makes the creation and adoption of deep learning algorithms difficult to implement.3434 Al Turkestani NN, Bianchi J, Deleat-Besson R, Le C, Tengfei L, Prieto JC, et al. Clinical decision support systems in orthodontics: a narrative review of data science approaches. Orthod Craniofac Res. 2021;24(suppl. 2):26-36.,3535 Kuraria A. Artificial Intelligence (AI); creating new perspectives for diagnosis in orthodontics: a review. Turkish Journal of Computer and Mathematics Education (TURCOMAT). 2021;12(13):203-5.

Orthodontics is particularly well suited for data mining, as it uses multiple related datasets, such as extra and intraoral examination, muscle function, dental casts analysis, cephalometric radiographs, and growth predictions. These separate datasets are difficult to organize and label for the orthodontist, and may be more easily processed with machine learning.3636 Allareddy V, Rengasamy Venugopalan S, Nalliah RP, Caplin JL, Lee MK, Allareddy V. Orthodontics in the era of big data analytics. Orthod Craniofacial Res. 2019;22(suppl. 1):8-13. These processes hold the promise of better individualizing diagnosis and treatment planning in the future.3737 Bichu YM, Hansa I, Bichu AY, Premjani P, Flores-Mir C, Vaid NR. Applications of artificial intelligence and machine learning in orthodontics: a scoping review. Prog Orthod. 2021;22(1):18. Currently, the profession uses this concept mainly for automated cephalometric analysis and simple treatment predictions. Aligner™ companies use AI to improve processes of tooth alignment and get a better and more predictable outcome.

There are two basic methods to train a neural network: supervised and unsupervised learning.

Supervised learning3838 Jiang T, Gradus JL, Rosellini AJ. Supervised machine learning: a brief primer. Behav Ther. 2020;51(5):675-87.

Supervised learning involves teaching an AI network a single task, such as an object recognition. The data is divided into discrete inputs (e.g., overbite, overjet, number of teeth, crowding, individual cephalometric points or measures) and fed into the neural network. With supervised learning, a segment of the dataset is used to create rules or activation functions, and applied to train the AI network until a satisfactory output is reached. Ninety percent accuracy is the typical minimum threshold. Once the programmed rules and activation functions prove satisfactory, a second dataset called the testing dataset is used to verify the initial network’s accuracy and consistency. Once satisfactory results are achieved with the training data set, the neural network is ready for prediction of future data.3939 Zhu XJ. Semi-supervised learning literature survey. Madison: University of Wisconsin-Madison; 2005.

Unsupervised learning and reinforcement learning

Unsupervised learning is based on the principles of back propagation and gradient descent (error analysis)2525 Alpaydin E. Introduction to machine learning. Cambridge: MIT press; 2009.,4040 Chollet F. Deep learning with Python. New York: Manning Publications; 2021.

41 Norgeot B, Glicksberg BS, Butte AJ. A call for deep-learning healthcare. Nat Med.. 2019;25(1):14-5.
-4242 Park A, Chute C, Rajpurkar P, Lou J, Ball RL, Shpanskaya K, et al. Deep learning-assisted diagnosis of cerebral aneurysms using the HeadXNet model. JAMA Netw Open. 2019;2(6):e195600., in which a large dataset of before and after treatment “inputs” is fed into the neural networks, without specific rules or instructions. Using multiple epochs (epoch is a full circle path of the network layers), the computer determines the correct weights or strengths of the connection(s) to be attributed to each input. The networks independently find correlations and develop the appropriate rules to obtain the most probable output, in relation to the inputs provided. Massive quantities of preferably clean data must be used to find significant correlations not apparent to the human operator. Unsupervised learning utilizes Jacobi’s mathematical principle called “starting with the end in mind”, or “man muss immer umkehren”.4343 Resnick C, Raileanu R, Kapoor S, Peysakhovich A, Cho K, Bruna J. Backplay:" M an muss immer umkehren". arXiv preprint arXiv:180706919. 2018. Jacobi found that reversing mathematical problems frequently led to their solution, while more conventional approaches led to an impasse. System errors can be limited through careful planning and the use of gradient descent, a function used to find the smallest error in the system4444 Lauzon FQ, editor. An introduction to deep learning. In: 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA). Montreal: IEEE; 2012. (Fig 2).

Figure 2:
Deep learning neural network.

“PREMEDITATION MALLORUM” OR PREMEDITATION OF EVILS (STOICS)4545 Kolokythas A. Greek philosophers-stoics and healthcare. Oral Surg Oral Med Oral Pathol Oral Radiol. 2022;133(5):501.

This principle states that one must:4646 Robertson D. The philosophy of cognitive-behavioural therapy (CBT): stoic philosophy as rational and cognitive psychotherapy. London: Routledge; 2018.

  1. Imagine all the negative outcomes that may happen during treatment, and plan for the unexpected.

  2. Adopt a worst-case scenario and avoid the “we will figure it out when we get there” approach to any intervention.

  3. Anticipate failure for any given treatment approach. A predictive approach rather than a reactive approach is adopted.

CURRENT USES OF AI BY ORTHODONTIC CORPORATIONS

Prior to the introduction of supercomputers, gathering and optimizing large data sets was a complicated task to perform. Invisalign, with its ClinCheck® program, was the first company to introduce easy to visualize outcomes, with a bidirectional (forward and backward) method to simultaneously examine the pretreatment and potential post-treatment outcome (simulation). Superimposition of pre and post models was made available for visualization (Fig 3).4747 Charalampakis O, Iliadi A, Ueno H, Oliver DR, Kim KB. Accuracy of clear aligners: A retrospective study of patients who needed refinement. Am J Orthod Dentofacial Orthop. 2018;154(1):47-54.,4848 Favero L, Terrazzani C, Favero V, Stellini E, Cocilovo F. Virtual study models: a comparison of modular application systems. Prog Orthod. 2009;10(2):16-25. These private corporations do not share their codes and the software architecture remains a closed one. Recently, open-source software such as Blender (Blender Foundation, Amsterdam, Netherlands) have been adapted to create add-ons to allow the clinicians to create their own simulation and treatment plans.

Figure 3:
A) Invisalign ClinCheck. B) Blender derived tooth movement from CBCT.

These add-ons based on the latest and constantly improving open-source technologies hold a lot of promise if the profession invests time and effort in their development.4949 Piedra-Cascón W, Hsu VT, Revilla-León M. Facially driven digital diagnostic waxing: new software features to simulate and define restorative outcomes. Curr Oral Health Rep. 2019;6(4):284-94.

AI OR AUGMENTED INTELLIGENCE APPLICATIONS IN ORTHODONTICS

Augmented intelligence is a subsection of AI in which the human factor is still predominant, and it uses the analytical and statistical powers of AI to improve outcome.5050 Rui Y. From artificial intelligence to augmented intelligence. IEEE MultiMed. 2017;24(1):4-5. Presently, supervised learning is used to virtually correct the malocclusion by presenting a probable outcome. With that outcome in mind, we can move backwards to the initial occlusion, in order to predict/foresee and avoid potential hindrances.5151 She Tsang Tsang F, Abuneviciute A, Fiorelli G. Visualizing treatment objectives and treatment planning using 2D and 3D occlusograms. 3D diagnosis and treatment planning in orthodontics. Cham: Springer; 2021. The weights are adjusted for each data input to reduce “cost or errors” to predict the true outcome associated to the expected outcome. The orthodontist then decides whether the probabilities of success are high enough before proceeding with the treatment (Fig 4).

Figure 4:
Diagnostic workflow to assist orthodontist in decision making.

The overarching principle is to finish the needed orthodontic correction in a cyber environment, then revert to original condition, to find the most appropriate treatment sequence that will be acceptable to the practitioner. This software opens the door for multiple simulations to be executed by the algorithms using several hundred datapoints. The orthodontist can then review the simulations, make the desired changes, and truly visualize the objectives of treatment. Orthodontics can move from a reactive to proactive treatment management.5252 Howard J. Artificial intelligence: implications for the future of work. Am J Ind Med. 2019;62(11):917-26.

EVOLUTION OF ORTHODONTICS DIAGNOSIS IN ORTHODONTICS 3.0: THE AGE OF DIGITIZATION AND 3D IMAGING

Until the 1990s, orthodontists relied on clinical observations, 2D radiographs and unmounted study casts.5353 Arnett GW, Bergman RT. Facial keys to orthodontic diagnosis and treatment planning. Part I. Am J Orthod Dentofacial Orthop. 1993;103(4):299-312.

54 Gebeck TR, Merrifield LL. Orthodontic diagnosis and treatment analysis-concepts and values: part II. Am J Orthod Dentofacial Orthop. 1995;107(5):541-7.
-5555 Gebeck TR, Merrifield LL. Orthodontic diagnosis and treatment analysis-concepts and values. Part I. Am J Orthod Dentofacial Orthop. 1995;107(4):434-43. Treatment planning relied heavily on both the experience of the operator and the underlying “treatment philosophies” of practice.5656 Andrews LF. The straight-wire appliance. Br J Orthod. 1979;6(3):125-43.,5757 Burstone CJ. Rationale of the segmented arch. Am J Orthod Dentofacial Orthop. 1962;48(11):805-22. Since 1993, it has been possible to visualize the true 3D malocclusion with CBCT and digital dental casts. These files were imported, manipulated, and measured in software such as OrthoCAD™5858 Bradley TG. Changes in orthodontic treatment modalities in the past 20 years: exploring the link between technology and scientific evidence. J Ir Dent Assoc. 2013;59(2):91-4.

59 Tanna NK, AlMuzaini A, Mupparapu M. Imaging in orthodontics. Dent Clin North Am. 2021;65(3):623-41.
-6060 Worthington P, Rubenstein J, Hatcher DC. The role of cone-beam computed tomography in the planning and placement of implants. J Am Dent Assoc. 2010;141(suppl. 3):19S-24S. and Dolphin imaging™ (Figs 5 and 6).

Figure 5:
A) CBCT with multiplanar view and 3D rendering. B) Enhanced CBCT image pre-segmentation, using the Drishti software ( The Australian National University, Canberra, Australia ).

Figure 6:
OrthoCAD™ for tooth, used for measurements.

USE OF DEEP LEARNING SOFTWARE FOR TREATMENT PLAN SIMULATIONS

Despite these technological advances, the diagnosis and treatment planning were still performed in the conventional way. These technologies were often reserved for complex malocclusions and orthognathic surgery, and not applied to more routine cases.6161 Alamri HM, Sadrameli M, Alshalhoob MA, Alshehri M. Applications of CBCT in dental practice: a review of the literature. Gen Dent. 2012;60(5):390-400; quiz 401-2.,6262 Yajima A, Otonari-Yamamoto M, Sano T, Hayakawa Y, Otonari T, Tanabe K, et al. Cone-beam CT (CB Throne(r)) Applied to Dentomaxillofacial Region. Bull Tokyo Dent Coll. 2006;47(3):133-41.

In 1997, Invisalign™ introduced automatic segmentation of teeth, to perform virtual tooth movement and create digital treatment simulations. Recently, several companies such as CephX™ and Diagnocat™ have developed deep learning algorithms to label teeth and cephalometric points, and automatically segment DICOM data into STL. This process allowed the files to be fused with the more detailed intraoral STL files, and imported into tooth moving software.6363 Bishara SE, Ortho D. Impacted maxillary canines: a review. Am J Orthod Dentofacial Orthop. 1992;101(2):159-71.

64 Ghahramani Z. Probabilistic machine learning and artificial intelligence. Nature. 2015;521(7553):452-9.

65 Orhan K, Bilgir E, Bayrakdar IS, Ezhov M, Gusarev M, Shumilov E. Evaluation of artificial intelligence for detecting impacted third molars on cone-beam computed tomography scans. J Stomatol Oral Maxillofac Surg. 2021;122(4):333-7.

66 Palanivel J, Davis D, Srinivasan D, Nc SC, Kalidass P, Kishore S, et al. Artificial intelligence-creating the future in orthodontics-a review. J Evol Med Dent Sci. 2021;10(28):2108-14.
-6767 Poonsri A, Aimjirakul N, Charoenpong T, Sukjamsri C, editors. Teeth segmentation from dental x-ray image by template matching. In: 9th Biomedical Engineering International Conference (BMEiCON). Luang Prabang: IEEE; 2016. Another company, Cavycon™, has developed a virtual articulator using an open-source software (Blender) (Figs 7 and 8).

Figure 7:
Segmentation of CBCT data using the Diagnocat™ software (Diagnocat Inc.) and deep learning algorithms.

Figure 8:
Segmented maxilla showing the bony contours and the roots.

These segmentation and fusion processes allow for significant improvement in orthodontic diagnosis and treatment planning. The possibility to virtually correct malocclusions in all three planes of space while incorporating the hard and soft tissues into the plan is available to the clinician with some computer knowledge. A virtual patient is created from the initially distinct datasets, which are fused, segmented and properly oriented to allow for the creation of realistic simulations6868 Enciso R, Memon A, Fidaleo DA, Neumann U, Mah J. The virtual craniofacial patient: 3D jaw modeling and animation. Stud Health Technol Inform. 2003;94:65-71.,6969 Joda T, Wolfart S, Reich S, Zitzmann NU. Virtual dental patient: how long until it's here? Curr Oral Health Rep. 2018;5(2):116-20. (Figs 9 and 10).

Figure 9:
XYZ coordinates using DDP software.

Figure 10:
Virtual articulator based on segmented CBCT data, using Blender add-on ( Cavycon ).

Biologic bone and soft tissue modeling and remodeling principles must be carefully considered. At this time, it cannot be accurately calculated. Despite its fairly high learning curve and time-consuming process, this powerful virtual environment enables the clinician to incorporate deep learning concepts into fully individualized orthodontic treatment planning.7070 Orhan K, Bayrakdar I, Ezhov M, Kravtsov A, Özyürek T. Evaluation of artificial intelligence for detecting periapical pathosis on cone-beam computed tomography scans. Int Endod J. 2020;53(5):680-9.

“INVERT, ALWAYS INVERT”

Once the virtual patient is created using these technologies, a deep neural network is used to predict the most appropriate treatment plan to correct the malocclusion within the physiological boundaries, and minimize treatment morbidity. The treatment simulation software and 3D occlusogram have the potential to virtually correct the malocclusion, determine the sequence or staging of treatment, and establish the biomechanical systems to be used (Fig 11).

Figure 11:
Digitally determined line of force of an impacted canine, created by a Python script in Blender software.

WHAT CAN DEEP LEARNING AND ESPECIALLY UNSUPERVISED LEARNING TEACH US? OPTIMIZE OUR OUTCOMES AND BE MORE EFFICIENT. DATA VS METHOD

It was demonstrated that by improving the quantity and quality of data and optimizing data labelling and classification, the outcome was improved by more than 15%,7171 Deng L, Hinton G, Kingsbury B, editors. New types of deep neural network learning for speech recognition and related applications: an overview. In: IEEE International Conference on Acoustics, Speech and Signal Processing. Vancouver: IEEE; 2013. far greater than the improvement from developing new methods or appliances. Data science has a tremendous potential to change the way orthodontics is performed, as practitioners tend to focus more on creating perfect tools than leveraging individual patient data.7272 Raghupathi W. Data mining in healthcare. In: Healthcare informatics: improving efficiency through technology, analytics, and management. Boca Raton: Auerbach; 2016. p. 353-72. The use of neural networks presents a considerable potential to improve the predictability of our treatments.7373 Nøkland A, Eidnes LH, editors. Training neural networks with local error signals. In: International Conference on Machine Learning. Long Beach: PMLR; 2019. The future that is built around the age of individualization and prediction will be to move toward a more data-centric model of diagnosis and treatment planning, and away from an experiential model.

AUGMENTED INTELLIGENCE TO THE SERVICE OF THE ORTHODONTIST?

1. Required diagnostic data:

  • a) Intraoral scan.

  • b) A centric relation registration.

  • c) Intra and extraoral photographs with reference points.

  • d) CBCT or 2D cephalograms (lateral and PA) oriented from the facial photographs.

In this section, neural networks may be used to automatically recognize points, perform measurements and segment intraoral scans and CBCT data. The use of these networks will speed up and enhance the diagnostic capabilities of the orthodontist.

2. Data analysis software

The data is then entered in a neural network where simulations are run using different parameters and algorithms. The case is then virtually finished to the highest standards, using the machine learning algorithms and the experience of the orthodontist5151 She Tsang Tsang F, Abuneviciute A, Fiorelli G. Visualizing treatment objectives and treatment planning using 2D and 3D occlusograms. 3D diagnosis and treatment planning in orthodontics. Cham: Springer; 2021.. One or several treatment options may be developed, evaluated, and appraised at that time (e.g., extraction vs non-extraction, surgical vs non-surgical). Once the orthodontist decides on the most appropriate treatment outcome, the staging is set; biomechanics, determined; and appliances, individually fabricated using 3D printed models and templates.

IS AI A BENEFIT OR A CURSE FOR OUR PROFESSION?

AI is changing our profession mainly without our involvement. Once shared with third parties, the clinician no longer owns or control the data. The companies manipulate the data, return a finished product without sharing the process. This is a feedforward process. As previously mentioned, data mining has the potential to unleash new treatment management that may be offered to any dental practitioners. Companies do offer their products to the widest possible market, and it is the responsibility of our profession to develop, maintain and protect our own algorithms into the hands of skillfully trained orthodontists. One method would be to develop a data repository (Data Management Coordination Center) and have our professional organizations create development platforms for research and development that result in product development that will benefit our profession.

Artificial Intelligence in dentistry is used mainly as narrow intelligence, which means that computers can accomplish one task at a time very efficiently if enough data is available and if training is provided by the programmer. Computers do not possess human intelligence and have no moral compass, no framework of compassion, intuition, or emotions. The state of consciousness, as defined by Kant in his book “Critique of Pure Reason”,7474 Smith NK. Immanuel Kant's critique of pure reason. Brighton: Blunt Press; 2007. is totally absent in computers, which makes them totally unaware of their environment. AI is therefore very far and very different from human intelligence.

The most promising avenue for the profession is to continue to develop augmented intelligence where the power of AI is harnessed by the orthodontist to the benefit of the patient. Orthodontist will realize that they possess and control the data necessary to optimize augmented intelligence. Technology is not a curse, but an opportunity to improve our profession, and it must be adopted within very strict boundaries.

CONCLUSIONS

Artificial Intelligence and Deep Learning are evolving at a galloping pace. The potential to harness their capacity to analyze large datasets and develop realistic treatment predictions is a promising advancement for Orthodontics. Experience-based diagnosis and treatment planning have greatly benefited the profession. The profession is now moving rapidly towards Orthodontic 4.0: “The age of treatment prediction, individualization and simulation”. The advent of augmented intelligence based on algorithms mining large datasets has the potential to expand the horizons of the orthodontist to improve the quality of life of our future orthodontic patients if controls on data mining are established with third parties.

REFERENCES

  • 1
    Ntoutsi E, Fafalios P, Gadiraju U, Iosifidis V, Nejdl W, Vidal ME, et al. Bias in data-driven artificial intelligence systems-an introductory survey. WIREs Data Mining Knowl Discov. 2020;10:e1356.
  • 2
    Alhashmi SF, Alshurideh M, Kurdi BA, Salloum SA. A systematic review of the factors affecting the artificial intelligence implementation in the health care sector. In: AICV 2020: Proceedings of the International Conference on Artificial Intelligence and Computer Vision (AICV2020). Springer; 2020.
  • 3
    He J, Baxter SL, Xu J, Xu J, Zhou X, Zhang K. The practical implementation of artificial intelligence technologies in medicine. Nat Med. 2019;25(1):30-6.
  • 4
    Gandedkar NH, Vaid NR, Darendeliler MA, Premjani P, Ferguson DJ, editors. The last decade in orthodontics: a scoping review of the hits, misses and the near misses! Semin Orthod. 2019;25(4):339-55.
  • 5
    Dreyer KJ, Hirschhorn D, Thrall JH, PACS M. A guide to the digital revolution. New York: Springer; 2006.
  • 6
    Chung HM, Gray P. Data mining. J Manage Inf Syst. 1999;16(1):11-6.
  • 7
    Leonardi R, Giudice AL, Isola G, Spampinato C. Deep learning and computer vision: two promising pillars, powering the future in orthodontics. Semin Orthod. 2021;27(1)2021.
  • 8
    Rosenblatt F. The perceptron: a probabilistic model for information storage and organization in the brain. Psychol Rev. 1958;65(6):386.
  • 9
    Aggarwal CC. Neural networks and deep learning. New York: Springer; 2018.
  • 10
    Mezard M, Nadal J-P. Learning in feedforward layered networks: the tiling algorithm. J Phys., A, Math Gen. 1989;22(12):2191.
  • 11
    Gardner MW, Dorling S. Artificial neural networks (the multilayer perceptron)-a review of applications in the atmospheric sciences. Atmos Environ. 1998;32(14-15):2627-36.
  • 12
    Helm JM, Swiergosz AM, Haeberle HS, Karnuta JM, Schaffer JL, Krebs VE, et al. Machine learning and artificial intelligence: definitions, applications, and future directions. Curr Rev Musculoskelet Med. 2020;13:69-76.
  • 13
    Bundy A. Preparing for the future of artificial intelligence. AI & Society. 2017;32(2):285-287.
  • 14
    Mohammad-Rahimi H, Nadimi M, Rohban MH, Shamsoddin E, Lee VY, Motamedian SR. Machine learning and orthodontics, current trends and the future opportunities: a scoping review. Am J Orthod Dentofacial Orthop. 2021;160(2):170-92.e4.
  • 15
    Kononenko I. Machine learning for medical diagnosis: history, state of the art and perspective. Artif Intell Med. 2001;23(1):89-109.
  • 16
    Khanagar SB, Al-Ehaideb A, Vishwanathaiah S, Maganur PC, Patil S, Naik S, et al. Scope and performance of artificial intelligence technology in orthodontic diagnosis, treatment planning, and clinical decision-making-A systematic review. J Dent Sc. 2021;16(1):482-92.
  • 17
    Mesko B. The role of artificial intelligence in precision medicine. Expert Review of Precision Medicine and Drug Development. 2017;2(5):239-241.
  • 18
    Akdeniz S, Tosun ME. A review of the use of artificial intelligence in orthodontics. J Exp Clin Med. 2021;38(S2):157-62.
  • 19
    Rousseau M, Retrouvey J-M. pfla: a python package for dental facial analysis using computer vision and statistical shape analysis. J Open Source Softw. 2018;3(32):855.
  • 20
    Tanikawa C, Yamashiro T. Development of novel artificial intelligence systems to predict facial morphology after orthognathic surgery and orthodontic treatment in Japanese patients. Sci Rep. 2021;11:15853.
  • 21
    LeCun Y, Bengio Y, Hinton G. Deep learning. Nature. 2015;521(7553):436-44.
  • 22
    Pennachin C, Goertzel B. Artificial general intelligence. Heidelberg: Springer; 2007.
  • 23
    Cheng B, Titterington DM. Neural networks: a review from a statistical perspective. Statist Sci. 1994;(1):2-30.
  • 24
    Pennachin C, Goertzel B. Contemporary approaches to artificial general intelligence. In: Artificial general intelligence: Heidelberg: Springer; 2007. p. 1-30.
  • 25
    Alpaydin E. Introduction to machine learning. Cambridge: MIT press; 2009.
  • 26
    Caruana R, Niculescu-Mizil A, editors. An empirical comparison of supervised learning algorithms. In: Proceedings of the 23rd international conference on Machine learning. Pittsburgh: Association for Computing Machinery; 2006.
  • 27
    Hackenberger BK. Bayes or not Bayes, is this the question? Croat Med J. 2019;60(1):50-2.
  • 28
    Lee J-H, Han S-S, Kim YH, Lee C, Kim I. Application of a fully deep convolutional neural network to the automation of tooth segmentation on panoramic radiographs. Oral Surg Oral Med Oral Pathol Oral Radiol. 2020;129(6):635-42.
  • 29
    Marr B. Big data: using smart big data, analytics and metrics to make better decisions and improve performance. Chichester: John Wiley & Sons; 2015.
  • 30
    Martin-Sanchez F, Verspoor K. Big data in medicine is driving big changes. Yearb Med Inform. 2014;9(1):14-20.
  • 31
    Koh HC, Tan G. Data mining applications in healthcare. J Healthc Inf Manag. 2005;19(2):64-72.
  • 32
    Hand DJ. Principles of data mining. Drug Saf. 2007;30(7):621-2.
  • 33
    Gullo F. From patterns in data to knowledge discovery: what data mining can do. Phys Procedia. 2015;62:18-22.
  • 34
    Al Turkestani NN, Bianchi J, Deleat-Besson R, Le C, Tengfei L, Prieto JC, et al. Clinical decision support systems in orthodontics: a narrative review of data science approaches. Orthod Craniofac Res. 2021;24(suppl. 2):26-36.
  • 35
    Kuraria A. Artificial Intelligence (AI); creating new perspectives for diagnosis in orthodontics: a review. Turkish Journal of Computer and Mathematics Education (TURCOMAT). 2021;12(13):203-5.
  • 36
    Allareddy V, Rengasamy Venugopalan S, Nalliah RP, Caplin JL, Lee MK, Allareddy V. Orthodontics in the era of big data analytics. Orthod Craniofacial Res. 2019;22(suppl. 1):8-13.
  • 37
    Bichu YM, Hansa I, Bichu AY, Premjani P, Flores-Mir C, Vaid NR. Applications of artificial intelligence and machine learning in orthodontics: a scoping review. Prog Orthod. 2021;22(1):18.
  • 38
    Jiang T, Gradus JL, Rosellini AJ. Supervised machine learning: a brief primer. Behav Ther. 2020;51(5):675-87.
  • 39
    Zhu XJ. Semi-supervised learning literature survey. Madison: University of Wisconsin-Madison; 2005.
  • 40
    Chollet F. Deep learning with Python. New York: Manning Publications; 2021.
  • 41
    Norgeot B, Glicksberg BS, Butte AJ. A call for deep-learning healthcare. Nat Med.. 2019;25(1):14-5.
  • 42
    Park A, Chute C, Rajpurkar P, Lou J, Ball RL, Shpanskaya K, et al. Deep learning-assisted diagnosis of cerebral aneurysms using the HeadXNet model. JAMA Netw Open. 2019;2(6):e195600.
  • 43
    Resnick C, Raileanu R, Kapoor S, Peysakhovich A, Cho K, Bruna J. Backplay:" M an muss immer umkehren". arXiv preprint arXiv:180706919. 2018.
  • 44
    Lauzon FQ, editor. An introduction to deep learning. In: 11th International Conference on Information Science, Signal Processing and their Applications (ISSPA). Montreal: IEEE; 2012.
  • 45
    Kolokythas A. Greek philosophers-stoics and healthcare. Oral Surg Oral Med Oral Pathol Oral Radiol. 2022;133(5):501.
  • 46
    Robertson D. The philosophy of cognitive-behavioural therapy (CBT): stoic philosophy as rational and cognitive psychotherapy. London: Routledge; 2018.
  • 47
    Charalampakis O, Iliadi A, Ueno H, Oliver DR, Kim KB. Accuracy of clear aligners: A retrospective study of patients who needed refinement. Am J Orthod Dentofacial Orthop. 2018;154(1):47-54.
  • 48
    Favero L, Terrazzani C, Favero V, Stellini E, Cocilovo F. Virtual study models: a comparison of modular application systems. Prog Orthod. 2009;10(2):16-25.
  • 49
    Piedra-Cascón W, Hsu VT, Revilla-León M. Facially driven digital diagnostic waxing: new software features to simulate and define restorative outcomes. Curr Oral Health Rep. 2019;6(4):284-94.
  • 50
    Rui Y. From artificial intelligence to augmented intelligence. IEEE MultiMed. 2017;24(1):4-5.
  • 51
    She Tsang Tsang F, Abuneviciute A, Fiorelli G. Visualizing treatment objectives and treatment planning using 2D and 3D occlusograms. 3D diagnosis and treatment planning in orthodontics. Cham: Springer; 2021.
  • 52
    Howard J. Artificial intelligence: implications for the future of work. Am J Ind Med. 2019;62(11):917-26.
  • 53
    Arnett GW, Bergman RT. Facial keys to orthodontic diagnosis and treatment planning. Part I. Am J Orthod Dentofacial Orthop. 1993;103(4):299-312.
  • 54
    Gebeck TR, Merrifield LL. Orthodontic diagnosis and treatment analysis-concepts and values: part II. Am J Orthod Dentofacial Orthop. 1995;107(5):541-7.
  • 55
    Gebeck TR, Merrifield LL. Orthodontic diagnosis and treatment analysis-concepts and values. Part I. Am J Orthod Dentofacial Orthop. 1995;107(4):434-43.
  • 56
    Andrews LF. The straight-wire appliance. Br J Orthod. 1979;6(3):125-43.
  • 57
    Burstone CJ. Rationale of the segmented arch. Am J Orthod Dentofacial Orthop. 1962;48(11):805-22.
  • 58
    Bradley TG. Changes in orthodontic treatment modalities in the past 20 years: exploring the link between technology and scientific evidence. J Ir Dent Assoc. 2013;59(2):91-4.
  • 59
    Tanna NK, AlMuzaini A, Mupparapu M. Imaging in orthodontics. Dent Clin North Am. 2021;65(3):623-41.
  • 60
    Worthington P, Rubenstein J, Hatcher DC. The role of cone-beam computed tomography in the planning and placement of implants. J Am Dent Assoc. 2010;141(suppl. 3):19S-24S.
  • 61
    Alamri HM, Sadrameli M, Alshalhoob MA, Alshehri M. Applications of CBCT in dental practice: a review of the literature. Gen Dent. 2012;60(5):390-400; quiz 401-2.
  • 62
    Yajima A, Otonari-Yamamoto M, Sano T, Hayakawa Y, Otonari T, Tanabe K, et al. Cone-beam CT (CB Throne(r)) Applied to Dentomaxillofacial Region. Bull Tokyo Dent Coll. 2006;47(3):133-41.
  • 63
    Bishara SE, Ortho D. Impacted maxillary canines: a review. Am J Orthod Dentofacial Orthop. 1992;101(2):159-71.
  • 64
    Ghahramani Z. Probabilistic machine learning and artificial intelligence. Nature. 2015;521(7553):452-9.
  • 65
    Orhan K, Bilgir E, Bayrakdar IS, Ezhov M, Gusarev M, Shumilov E. Evaluation of artificial intelligence for detecting impacted third molars on cone-beam computed tomography scans. J Stomatol Oral Maxillofac Surg. 2021;122(4):333-7.
  • 66
    Palanivel J, Davis D, Srinivasan D, Nc SC, Kalidass P, Kishore S, et al. Artificial intelligence-creating the future in orthodontics-a review. J Evol Med Dent Sci. 2021;10(28):2108-14.
  • 67
    Poonsri A, Aimjirakul N, Charoenpong T, Sukjamsri C, editors. Teeth segmentation from dental x-ray image by template matching. In: 9th Biomedical Engineering International Conference (BMEiCON). Luang Prabang: IEEE; 2016.
  • 68
    Enciso R, Memon A, Fidaleo DA, Neumann U, Mah J. The virtual craniofacial patient: 3D jaw modeling and animation. Stud Health Technol Inform. 2003;94:65-71.
  • 69
    Joda T, Wolfart S, Reich S, Zitzmann NU. Virtual dental patient: how long until it's here? Curr Oral Health Rep. 2018;5(2):116-20.
  • 70
    Orhan K, Bayrakdar I, Ezhov M, Kravtsov A, Özyürek T. Evaluation of artificial intelligence for detecting periapical pathosis on cone-beam computed tomography scans. Int Endod J. 2020;53(5):680-9.
  • 71
    Deng L, Hinton G, Kingsbury B, editors. New types of deep neural network learning for speech recognition and related applications: an overview. In: IEEE International Conference on Acoustics, Speech and Signal Processing. Vancouver: IEEE; 2013.
  • 72
    Raghupathi W. Data mining in healthcare. In: Healthcare informatics: improving efficiency through technology, analytics, and management. Boca Raton: Auerbach; 2016. p. 353-72.
  • 73
    Nøkland A, Eidnes LH, editors. Training neural networks with local error signals. In: International Conference on Machine Learning. Long Beach: PMLR; 2019.
  • 74
    Smith NK. Immanuel Kant's critique of pure reason. Brighton: Blunt Press; 2007.

Publication Dates

  • Publication in this collection
    06 Jan 2023
  • Date of issue
    2022

History

  • Received
    28 Feb 2022
  • Accepted
    03 Oct 2022
Dental Press International Av. Luís Teixeira Mendes, 2712 , 87015-001 - Maringá - PR, Tel: (55 44) 3033-9818 - Maringá - PR - Brazil
E-mail: artigos@dentalpress.com.br