As I learn more about AI and it’s functionalities, I’ve come to realize that there’s something even more important than it’s functions or engagement, it’s also about responsibility. A recent tutorial where we talked about how some of my target audience may be vulnerable people really made me pause and thank about how Jeff could potentially impact users, both positively and negatively. The last thing I want is for my tool to unintentionally cause harm. Jeff is a reflective tool and not a therapeutic tool, and I need to make that distinction clear.
Being Transparent About What Jeff Is (and Isn’t)
One of the steps I’ve taken is making it clear what Jeff is supposed to do. It’s a reflective tool, not therapy, and I’ve added disclaimers to make sure users understand that. It’s there to guide and support, but it’s not a replacement for professional help. This transparency feels really important as people need to know exactly what they’re engaging with.
Safeguards
I’ve also put specific guardrails in place to make sure that Jeff doesn’t bring up emotionally charged or sensitive topics like self-harm, and if a user mentions them, Jeff will redirect them to mental health resources.
Another consideration is preventing users from becoming overly reliant on Jeff. While Jeff’s aim is to support reflection and encourage confidence-building, there is a risk of users seeing it as a crutch rather than a stepping stone. To address this, I’m working to implement features that nudge users towards real-life actions and balance.
For example, during each session, Jeff will keep reminding users that true progress happens offline, and encouraging them to step into the real-world situations to apply what they have rehearsed.
Acknowledgement
I fully acknowledge the ethical considerations inherent in developing a tool like Jeff, which walks a fine line between being a therapeutic tool and not. While my current focus has been on enhancing Jeff’s engagement and functionality, I do recognize that ethical responsibility must also be an important aspect to this development. Moving forward, I intend to dedicate more time and research into AI ethics, including consulting with experts to make sure that I have not made any oversights, and if any, are to be identified and addressed.