a.

McMASTER FACULTY OF ENGINEERING

An artificial intelligence process for applying policy frameworks towards judicial analytic systems

Arwin Chan, Greig Mordue August 2019

ABSTRACT

Prompted by the continued success of artificial intelligence (AI) programs, a recent upswing of strategies and policy frameworks have emerged to address the governance of this emerging industry. In order to better understand the trends within these publications, this paper proposes a natural language processing (NLP) model as a tool to interpret the relevance and development of these texts on an emerging policy issue. Using the regulation of judicial analytic systems as a case study, the paper applies topic modelling and semantic textual similarity algorithms to determine the relationship between each collected framework and the case study, along with exploring topical trends within the different sectors. The NLP model successfully identifies the applicability and strength of each framework, suggesting that AI programs will not only become a core consideration in policy development, but that the programs themselves will aid in the creation of future governance strategies.

Keywords

technology policy, policy frameworks, artificial intelligence, natural language processing, legal prediction, judicial analytics, data protection

AUTHORS

REFERENCES

[1] AILaw. (2017, May 29). List of French Legal Tech Startups. Akasaka International Law, Patent & Accounting Office. Retrieved from https://ailaw.co.jp/en/
[2] Aletras, N., Tsarapatsanis, D., Preoţiuc-Pietro, D., & Lampos, V. (2016). Predicting judicial decisions of the European Court of Human Rights: A natural language processing perspective. PeerJ Computer Science, 2, e93.
[3] Artificial Lawyer (2019, June 4). France Bans Judge Analytics, 5 Years In Prison For Rule Breakers. Retrieved from https://www.artificiallawyer.com/
[4] Bentata, P., & Hiriart, Y. (2015). Biased Judges: Evidence from French Environmental Cases.
[5] Blei, D. M., Ng, A. Y., & Jordan, M. I. (2003). Latent dirichlet allocation. Journal of machine Learning research, 3(Jan), 993-1022.
[6] Calo, R. (2017). Artificial Intelligence policy: a primer and roadmap. UCDL Rev., 51, 399.
[7] Campbell, M. (1999, November). Knowledge Discovery in Deep Blue. Communications of the ACM. Vol. 42, No. 11.
[8] The Canadian Institute for Advanced Research (2019). CIFAR Pan-Canadian Artificial Intelligence Strategy. Retrieved from https://www.cifar.ca/ai/
[9] Citron, D., & Calo, R. (2019, April 8). The Automated Administrative State. The Ethical Machine. Retrieved from https://ai.shorensteincenter.org/
[10] Chen, D. L. (2019). Judicial analytics and the great transformation of American Law. Artificial Intelligence and Law, 27(1), 15-42.
[11] Chen, E. (2011, August 22). Introduction to Latent Dirichlet Allocation. Retrieved from http://blog.echen.me
[12] Collobert, R., & Weston, J. (2008, July). A unified architecture for natural language processing: Deep neural networks with multitask learning. In Proceedings of the 25th international conference on Machine learning (pp. 160-167). ACM.
[13] Connett, I. (2019, June 10). France Resists Judicial AI Revolution. Above The Law. Retrieved from https://abovethelaw.com/
[14] Consulting.com. (2019). The Top 50 Consulting Firms In 2019. Retrieved from https://www.consulting.com/
[15] DeepMind (2019). Exploring the real-world impacts of AI. Ethics & Society Team. Retrieved from https://deepmind.com
[16] Delavigne, A., Gajzler, A., and Marin, A. (2017, July). The Challenges facing Justice in the future: Judges confronted with the advent of Big Data Analytics. EJTN THEMIS 2017. Retrieved from http://www.ejtn.eu/
[17] Deloitte (2019). Canada’s AI imperative: Overcoming risks, building trust. Omnia AI. Retrieved from https://www2.deloitte.com/ca
[18] Department for Digital, Culture, Media & Sport. (2018, November 20) Centre for Data Ethics and Innovation Consultation. Retrieved from https://www.gov.uk/
[19] Dutton, T. (2018a, May 7). A Timeline for Europe’s AI Strategy. The Startup. Retrieved from https://medium.com/swlh/
[20] Dutton, T. (2018b, June 28). An Overview of National AI Strategies. Politics + AI. Retrieved from https://medium.com/politics-ai/
[21] European Commission. (2019, May 2). High-Level Expert Group on Artificial Intelligence. Retrieved from https://ec.europa.eu/
[22] Fortune (2019). Search Global 500. Retrieved from https://fortune.com/
[23] Gagne, JF. (2019). Global AI Talent Report 2019. Retrieved from https://jfgagne.ai/
[24] Garrison, T. (2015). STS Departments, Programs, and Centers Worldwide. Cornell University Department of Science & Technology Studies. Retrieved from https://sts.cornell.edu/
[25] Gasser, U., & Almeida, V. A. (2017). A layered model for AI governance. IEEE Internet Computing, 21(6), 58-62.
[26] Government of Canada. (2019, February 5). Directive on the Use of Machine Learning for Decision-Making. Retrieved from https://www.tbs-sct.gc.ca/
[27] Holdren, J., & Bruce, A. (2016, October). Preparing for the Future of Artificial Intelligence.National Science and Technology Council. Retrieved from https://obamawhitehouse.archives.gov/
[28] Miailhe, N., & Hodes, C. (2017). Making the AI revolution work for everyone. The Future Society.
[29] Kahn, K. (2002, March). It’s Alive! Wired. Retrieved from https://www.wired.com/
[30] Kolanovic, M., & Krishnamachari, R. (2017). Big Data and AI Strategies.
[31] Li, S. (2018, May 31). Topic Modeling and Latent Dirichlet Allocation (LDA) in Python. Towards Data Science. Retrieved from https://towardsdatascience.com/
[32] Liebman, B. L., Roberts, M., Stern, R. E., & Wang, A. (2017). Mass digitization of Chinese court decisions: How to use text as data in the field of Chinese law. 21st Century China Center Research Paper, (2017-01).
[33] Lin, D., & Wu, X. (2009, August). Phrase clustering for discriminative learning. In Proceedings of the Joint Conference of the 47th Annual Meeting of the ACL and the 4th International Joint Conference on Natural Language Processing of the AFNLP: Volume 2-Volume 2 (pp. 1030-1038). Association for Computational Linguistics.
[34] Livermore, M., & Rockmore, D. (2019, June 21). France Kicks Data Scientists Out of Its Courts. Slate. Retrieved from https://slate.com/
[35] LOI n° 2019-222 du 23 mars 2019 de programmation 2018-2022 et de réforme pour la justice (1) - Article 33 (2019, March). Retreived from https://www.legifrance.gouv.fr/
[36] Marique, Y., & Slautsky, E. (2019). Freedom of information in France: Law and practice. In The Laws of Transparency in Action (pp. 73-118). Palgrave Macmillan, Cham.
[37] McCorduck, P. (2004). Machines Who Think: A Personal Inquiry into the History and Prospects of Artificial Intelligence. A K Peters, Ltd.
[38] IBM Research. (2006, May). How Deep Blue works. Retrieved from http://researchweb.watson.ibm.com/
[39] Rayo, E. (2019, May 20). AI in Law and Legal Practice – A Comprehensive View of 35 Current Applications. Emerj. Retrieved from https://emerj.com/
[40] Russell, S. J., & Norvig, P. (2010). Artificial intelligence: a modern approach. (3rd Ed). Malaysia; Pearson Education Limited,.
[41] Senin, P. (2016, October 27). Vector Space Model (VSM). SAX-VSM. Retrieved from https://jmotif.github.io/sax-vsm_site/
[42] Sieg, A. (2018, July 4). Text Similarities: Estimate the degree of similarity between two texts. Retrieved from https://medium.com/
[43] Strome, E. (2019). Annual Report of the CIFAR Pan-Canadian AI Strategy. CIFAR.
[44] Vergottis, A. (2018, June 24). Current State of Artificial Intelligence. InfiniCog. Retrieved from https://medium.com/infinicog/
[45] Villani, C. (2018). For a Meaningful Artificial Intelligence: Towards a French and European Strategy. AI for Humanity. Retrieved from https://www.aiforhumanity.fr/
[46] Yaraghi, N. (2018, June 11). A case against the General Data Protection Regulation. Brookings. Retrieved from https://www.brookings.edu/
[47] Zeng, Y., Lu, E., & Huangfu, C. (2018). Linking Artificial Intelligence Principles. arXiv preprint arXiv:1812.04814.