{"componentChunkName":"component---src-templates-project-template-js","path":"/projects/tomato-ai-real-time-voice-accent-modification","result":{"data":{"project":{"title":"Tomato AI - Real-Time Voice Accent Modification","slug":"tomato-ai-real-time-voice-accent-modification","description":"Built the complete infrastructure for real-time voice accent modification on live SIP calls over 7 months. Created a custom FreeSWITCH plugin (mod_tomato) that intercepts the caller's audio stream, sends it to an ML inference model via bidirectional gRPC, and re-inserts the accent-modified audio back into the live call. Integrated NVIDIA Triton Inference Server via a C++ client for model serving. Built SIP proxy handling both signaling and media traffic, deployed Asterisk-based call center with multi-agent support, IVR menus, and inbound DID. Verified selective voice modification on incoming and outgoing call legs per agent. System accepted live calls from mobile phones on public networks. Produced full restoration documentation and AWS asset mapping at project closure.","caseStudy":"## Stack & Architecture\n\nBuilt with FreeSWITCH, gRPC, Triton, C++, SIP, Asterisk, AWS. Delivered for Tomato AI, 2023-05–2023-12.\n\n<!-- Auto-drafted from profile data. Add problem/approach detail as needed. -->\n","gallery":[],"date_start":"2023-05","date_end":"2023-12","hours":null,"client":"Tomato AI","tags":["ai-ml","infrastructure","voip","real-time"],"outcomes":["Built custom FreeSWITCH plugin (mod_tomato) for real-time audio stream interception","Integrated NVIDIA Triton Inference Server via C++ gRPC client","Deployed full SIP proxy and Asterisk call center with multi-agent support","Live calls from mobile phones on public networks with selective accent modification"],"tech_stack":["FreeSWITCH","gRPC","Triton","C++","SIP","Asterisk","AWS"],"links":[{"label":"Live","url":"https://tomato.ai"}],"image":{"childImageSharp":{"fluid":{"tracedSVG":"data:image/svg+xml,%3csvg%20xmlns='http://www.w3.org/2000/svg'%20width='400'%20height='229'%20viewBox='0%200%20400%20229'%20preserveAspectRatio='none'%3e%3cpath%20d='M0%20115v114h21c16%200%2022-1%2023-2%203-1%205-1%203%201s-1%201%203-1c5-3%205-3%202-3h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1c3-2%204-3%204-1l1%201c2%200%204-3%202-3v-2h4l1%201%202-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1c3-2%204-3%204-1l1%201%202-1%201-1%201-1c1-1%200-1-1-1h-1c3-2%204-3%204-1v1l1-2h1c1%200%202%200%201-1l1-2v1l2%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%201%201%203-1v-1h-2v-2c-2%200-2-1-2-5%201-8%203-8%203%200%200%205%200%205%201%201%200-4%200-4%203-4l3-1v-1l1%201h1c1-2%203-3%203%200-1%201%200%202%203%201h3v-1l2-2c3-2%205-3%203%200l-1%201%203-1%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-2%201-1%201-1c1-1%200-1-1-1-2%201-3%200-2-1l-1-1c-1%201-1%201%200%200%200-2-1-2-4-2s-3%200-2%201v1c-1-1-2%200-2%201l-2%201c-4%200-4%200%201-11%204-12%206-12%2011-1%202%206%203%207%203%204%201-2%201-2%201%201v6c1%201%201-3%201-9%200-10%200-10%203-10%202%200%202%200%202%2010v11l1-8%201-6v3c0%201%200%202%202%201v1c-2%202-3%204%200%203l1%201c-1%201-1%201%201%201l3-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1c3-2%204-3%204-1l1%201%202-1%201-1%201-1c1-1%200-1-1-1h-1c3-2%204-3%204-1v1l1-2h1c1%200%202%200%201-1l1-2v1l2%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1c3-2%204-3%204-1l1%201c2%200%204-3%202-3v-2h4l1%201%202-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1l3-1%202%201%203-1%201-2c1-1%200-1-1-1h-1c3-2%204-3%204-1l3-1%202-1v101l1%20102V0H0v115m139-28c-2%201-1%203%202%203%202%200%203%201%203%208s0%208%202%208%202-1%202-8v-8h3c2%200%203%200%203-2-1-2-14-3-15-1m68%203c-2%203-3%205-1%205l1%205c0%205%201%206%204%206%202%200%203%200%203-2l-1-2c-2%200-2-1-2-3%200-3%200-4%202-4l1-2-1-2-2-2c0-3-2-2-4%201m-51%202c-4%202-5%2011%200%2013%205%203%2011%200%2011-6s-5-9-11-7m14%200l-1%207c0%206%200%207%202%207s2-1%202-4c0-5%201-7%203-7l1%206c0%205%200%205%202%205s3-1%203-6c0-7%203-7%203%201%200%205%200%205%203%205%202%200%202%200%202-5%200-8-2-11-7-9h-13m24%201c-3%202-2%203%202%202l4%201-3%201c-4%200-7%203-5%206%201%203%201%203%207%203h6l-1-6-2-8c-2-1-7-1-8%201m23%200c-3%203-3%209%200%2011%202%203%208%202%2010%200%206-6-3-17-10-11m-56%2038l-2%206%201%201%203-5%201-4%201%204c2%206%204%206%205%202%202-3%202-3%202-1%201%203%203%205%206%203%204-2%202-7-3-7l-2-1c0-3-2-2-3%202l-2%204-1-3-1-4-2-1-3%204'%20fill='%23d3d3d3'%20fill-rule='evenodd'/%3e%3c/svg%3e","aspectRatio":1.7543859649122806,"src":"/static/76981b7e21c32c11f2c961bf111a3a40/ee604/tomato-ai.png","srcSet":"/static/76981b7e21c32c11f2c961bf111a3a40/69585/tomato-ai.png 200w,\n/static/76981b7e21c32c11f2c961bf111a3a40/497c6/tomato-ai.png 400w,\n/static/76981b7e21c32c11f2c961bf111a3a40/ee604/tomato-ai.png 800w","srcWebp":"/static/76981b7e21c32c11f2c961bf111a3a40/58556/tomato-ai.webp","srcSetWebp":"/static/76981b7e21c32c11f2c961bf111a3a40/61e93/tomato-ai.webp 200w,\n/static/76981b7e21c32c11f2c961bf111a3a40/1f5c5/tomato-ai.webp 400w,\n/static/76981b7e21c32c11f2c961bf111a3a40/58556/tomato-ai.webp 800w","sizes":"(max-width: 800px) 100vw, 800px"}}},"stack_icons":[{"name":"FreeSWITCH","icon":{"childImageSharp":{"fixed":{"tracedSVG":"data:image/svg+xml,%3csvg%20xmlns='http://www.w3.org/2000/svg'%20width='24'%20height='24'%20viewBox='0%200%2024%2024'%20preserveAspectRatio='none'%3e%3cpath%20d='M1%201v22c2%202%2020%201%2022-1s3-22%201-21H1'%20fill='%23d3d3d3'%20fill-rule='evenodd'/%3e%3c/svg%3e","width":24,"height":24,"src":"/static/c88a64d8c2151b2ed3052ae194092a73/6d1ba/freeswitch.png","srcSet":"/static/c88a64d8c2151b2ed3052ae194092a73/6d1ba/freeswitch.png 1x,\n/static/c88a64d8c2151b2ed3052ae194092a73/a9c35/freeswitch.png 1.5x,\n/static/c88a64d8c2151b2ed3052ae194092a73/559c9/freeswitch.png 2x","srcWebp":"/static/c88a64d8c2151b2ed3052ae194092a73/f8bad/freeswitch.webp","srcSetWebp":"/static/c88a64d8c2151b2ed3052ae194092a73/f8bad/freeswitch.webp 1x,\n/static/c88a64d8c2151b2ed3052ae194092a73/f81b6/freeswitch.webp 1.5x,\n/static/c88a64d8c2151b2ed3052ae194092a73/804d1/freeswitch.webp 2x"}}}},{"name":"gRPC","icon":{"childImageSharp":{"fixed":{"tracedSVG":"data:image/svg+xml,%3csvg%20xmlns='http://www.w3.org/2000/svg'%20width='24'%20height='24'%20viewBox='0%200%2024%2024'%20preserveAspectRatio='none'%3e%3cpath%20d='M1%201v22c2%202%2020%201%2022-1s3-22%201-21H1'%20fill='%23d3d3d3'%20fill-rule='evenodd'/%3e%3c/svg%3e","width":24,"height":24,"src":"/static/df4dddef5891bac996416476066a0768/6d1ba/grpc.png","srcSet":"/static/df4dddef5891bac996416476066a0768/6d1ba/grpc.png 1x,\n/static/df4dddef5891bac996416476066a0768/a9c35/grpc.png 1.5x,\n/static/df4dddef5891bac996416476066a0768/559c9/grpc.png 2x","srcWebp":"/static/df4dddef5891bac996416476066a0768/f8bad/grpc.webp","srcSetWebp":"/static/df4dddef5891bac996416476066a0768/f8bad/grpc.webp 1x,\n/static/df4dddef5891bac996416476066a0768/f81b6/grpc.webp 1.5x,\n/static/df4dddef5891bac996416476066a0768/804d1/grpc.webp 2x"}}}},{"name":"Triton","icon":{"childImageSharp":{"fixed":{"tracedSVG":"data:image/svg+xml,%3csvg%20xmlns='http://www.w3.org/2000/svg'%20width='24'%20height='24'%20viewBox='0%200%2024%2024'%20preserveAspectRatio='none'%3e%3cpath%20d='M1%201v22c2%202%2020%201%2022-1s3-22%201-21H1m8%207c-2%201-2%202-1%202H7c-3%200-3%202%201%205l7%202h4V7h-4L9%208'%20fill='%23d3d3d3'%20fill-rule='evenodd'/%3e%3c/svg%3e","width":24,"height":24,"src":"/static/13156ea5fac4d32a5e32d3c8b5976118/6d1ba/triton.png","srcSet":"/static/13156ea5fac4d32a5e32d3c8b5976118/6d1ba/triton.png 1x,\n/static/13156ea5fac4d32a5e32d3c8b5976118/a9c35/triton.png 1.5x,\n/static/13156ea5fac4d32a5e32d3c8b5976118/559c9/triton.png 2x","srcWebp":"/static/13156ea5fac4d32a5e32d3c8b5976118/f8bad/triton.webp","srcSetWebp":"/static/13156ea5fac4d32a5e32d3c8b5976118/f8bad/triton.webp 1x,\n/static/13156ea5fac4d32a5e32d3c8b5976118/f81b6/triton.webp 1.5x,\n/static/13156ea5fac4d32a5e32d3c8b5976118/804d1/triton.webp 2x"}}}},{"name":"C++","icon":{"childImageSharp":{"fixed":{"tracedSVG":"data:image/svg+xml,%3csvg%20xmlns='http://www.w3.org/2000/svg'%20width='24'%20height='24'%20viewBox='0%200%2024%2024'%20preserveAspectRatio='none'%3e%3cpath%20d='M1%201v22c2%202%2020%201%2022-1s3-22%201-21H1'%20fill='%23d3d3d3'%20fill-rule='evenodd'/%3e%3c/svg%3e","width":24,"height":24,"src":"/static/f34f1b6f56e1d638285c02a3210583d8/6d1ba/cpp.png","srcSet":"/static/f34f1b6f56e1d638285c02a3210583d8/6d1ba/cpp.png 1x,\n/static/f34f1b6f56e1d638285c02a3210583d8/a9c35/cpp.png 1.5x,\n/static/f34f1b6f56e1d638285c02a3210583d8/559c9/cpp.png 2x","srcWebp":"/static/f34f1b6f56e1d638285c02a3210583d8/f8bad/cpp.webp","srcSetWebp":"/static/f34f1b6f56e1d638285c02a3210583d8/f8bad/cpp.webp 1x,\n/static/f34f1b6f56e1d638285c02a3210583d8/f81b6/cpp.webp 1.5x,\n/static/f34f1b6f56e1d638285c02a3210583d8/804d1/cpp.webp 2x"}}}},{"name":"SIP","icon":{"childImageSharp":{"fixed":{"tracedSVG":"data:image/svg+xml,%3csvg%20xmlns='http://www.w3.org/2000/svg'%20width='24'%20height='24'%20viewBox='0%200%2024%2024'%20preserveAspectRatio='none'%3e%3cpath%20d='M1%201v22c2%202%2020%201%2022-1s3-22%201-21H1'%20fill='%23d3d3d3'%20fill-rule='evenodd'/%3e%3c/svg%3e","width":24,"height":24,"src":"/static/e21b2aebeecd6c9127affb666c0583a5/6d1ba/sip.png","srcSet":"/static/e21b2aebeecd6c9127affb666c0583a5/6d1ba/sip.png 1x,\n/static/e21b2aebeecd6c9127affb666c0583a5/a9c35/sip.png 1.5x,\n/static/e21b2aebeecd6c9127affb666c0583a5/559c9/sip.png 2x","srcWebp":"/static/e21b2aebeecd6c9127affb666c0583a5/f8bad/sip.webp","srcSetWebp":"/static/e21b2aebeecd6c9127affb666c0583a5/f8bad/sip.webp 1x,\n/static/e21b2aebeecd6c9127affb666c0583a5/f81b6/sip.webp 1.5x,\n/static/e21b2aebeecd6c9127affb666c0583a5/804d1/sip.webp 2x"}}}},{"name":"Asterisk","icon":{"childImageSharp":{"fixed":{"tracedSVG":"data:image/svg+xml,%3csvg%20xmlns='http://www.w3.org/2000/svg'%20width='24'%20height='24'%20viewBox='0%200%2024%2024'%20preserveAspectRatio='none'%3e%3cpath%20d='M1%201v22c2%202%2020%201%2022-1s3-22%201-21H1'%20fill='%23d3d3d3'%20fill-rule='evenodd'/%3e%3c/svg%3e","width":24,"height":24,"src":"/static/6558392c896903e1eb3ace75c92a0042/6d1ba/asterisk.png","srcSet":"/static/6558392c896903e1eb3ace75c92a0042/6d1ba/asterisk.png 1x,\n/static/6558392c896903e1eb3ace75c92a0042/a9c35/asterisk.png 1.5x,\n/static/6558392c896903e1eb3ace75c92a0042/559c9/asterisk.png 2x","srcWebp":"/static/6558392c896903e1eb3ace75c92a0042/f8bad/asterisk.webp","srcSetWebp":"/static/6558392c896903e1eb3ace75c92a0042/f8bad/asterisk.webp 1x,\n/static/6558392c896903e1eb3ace75c92a0042/f81b6/asterisk.webp 1.5x,\n/static/6558392c896903e1eb3ace75c92a0042/804d1/asterisk.webp 2x"}}}},{"name":"AWS","icon":{"childImageSharp":{"fixed":{"tracedSVG":"data:image/svg+xml,%3csvg%20xmlns='http://www.w3.org/2000/svg'%20width='24'%20height='24'%20viewBox='0%200%2024%2024'%20preserveAspectRatio='none'%3e%3cpath%20d='M0%2012v12h25V12c0-7-1-9-1-6%200%207%200%207-2%205-2-1-2-1-1%201l-1%203-1%203c0%202-1%203-6%203-7%200-7%200-8-9-1-6%200-8%205-9%204%200%204%200%202-2L5%200H0v12'%20fill='%23d3d3d3'%20fill-rule='evenodd'/%3e%3c/svg%3e","width":20,"height":20,"src":"/static/aeecd41e51f030856d95a6b2606de3da/dba72/aws-s3.png","srcSet":"/static/aeecd41e51f030856d95a6b2606de3da/dba72/aws-s3.png 1x","srcWebp":"/static/aeecd41e51f030856d95a6b2606de3da/e3c56/aws-s3.webp","srcSetWebp":"/static/aeecd41e51f030856d95a6b2606de3da/e3c56/aws-s3.webp 1x"}}}}]}},"pageContext":{"slug":"tomato-ai-real-time-voice-accent-modification"}},"staticQueryHashes":["3724428426"]}