<?xml version="1.0" encoding="UTF-8"?><rss version="2.0"
	xmlns:content="http://purl.org/rss/1.0/modules/content/"
	xmlns:wfw="http://wellformedweb.org/CommentAPI/"
	xmlns:dc="http://purl.org/dc/elements/1.1/"
	xmlns:atom="http://www.w3.org/2005/Atom"
	xmlns:sy="http://purl.org/rss/1.0/modules/syndication/"
	xmlns:slash="http://purl.org/rss/1.0/modules/slash/"
	
	xmlns:georss="http://www.georss.org/georss"
	xmlns:geo="http://www.w3.org/2003/01/geo/wgs84_pos#"
	>

<channel>
	<title>corrected &#8211; Spress</title>
	<atom:link href="https://en.spress.net/tag/corrected/feed/" rel="self" type="application/rss+xml" />
	<link>https://en.spress.net</link>
	<description>Spress is a general newspaper in English which is updated 24 hours a day.</description>
	<lastBuildDate>Wed, 23 Jun 2021 15:20:14 +0000</lastBuildDate>
	<language>en-US</language>
	<sy:updatePeriod>
	hourly	</sy:updatePeriod>
	<sy:updateFrequency>
	1	</sy:updateFrequency>
	
<site xmlns="com-wordpress:feed-additions:1">191965906</site>	<item>
		<title>Incorrect interest calculations BaFin takes advantage of premium savings contracts that have long promised savers big money. However, in the low interest rate phase, many banks corrected the promised profit commitments downwards. BaFin is now intervening &#8211; in the interests of customers. By Ursula Mayer.</title>
		<link>https://en.spress.net/incorrect-interest-calculations-bafin-takes-advantage-of-premium-savings-contracts-that-have-long-promised-savers-big-money-however-in-the-low-interest-rate-phase-many-banks-corrected-the-promised/</link>
		
		<dc:creator><![CDATA[editor]]></dc:creator>
		<pubDate>Wed, 23 Jun 2021 15:20:14 +0000</pubDate>
				<category><![CDATA[Business]]></category>
		<category><![CDATA[advantage]]></category>
		<category><![CDATA[BaFin]]></category>
		<category><![CDATA[Banks]]></category>
		<category><![CDATA[Big]]></category>
		<category><![CDATA[calculations]]></category>
		<category><![CDATA[commitments]]></category>
		<category><![CDATA[contracts]]></category>
		<category><![CDATA[corrected]]></category>
		<category><![CDATA[Customers]]></category>
		<category><![CDATA[German]]></category>
		<category><![CDATA[Germany]]></category>
		<category><![CDATA[Incorrect]]></category>
		<category><![CDATA[Interest]]></category>
		<category><![CDATA[Interests]]></category>
		<category><![CDATA[intervening]]></category>
		<category><![CDATA[long]]></category>
		<category><![CDATA[Mayer]]></category>
		<category><![CDATA[money]]></category>
		<category><![CDATA[phase]]></category>
		<category><![CDATA[Premium]]></category>
		<category><![CDATA[Premium savings contracts]]></category>
		<category><![CDATA[profit]]></category>
		<category><![CDATA[Promised]]></category>
		<category><![CDATA[rate]]></category>
		<category><![CDATA[savers]]></category>
		<category><![CDATA[Savings]]></category>
		<category><![CDATA[takes]]></category>
		<category><![CDATA[Thousands of]]></category>
		<category><![CDATA[Ursula]]></category>
		<guid isPermaLink="false">https://en.spress.net/?p=27034</guid>

					<description><![CDATA[Wrong interest calculations BaFin is taking action Status: 21.06.2021 5:08 p.m. Premium savings contracts have long promised savers big money. However, in the low interest rate phase, many banks corrected the promised profit commitments downwards. BaFin is now intervening &#8211; in the interests of customers. From Ursula Mayer, Mr The Federal Financial Supervisory Authority BaFin [&#8230;]]]></description>
										<content:encoded><![CDATA[</p>
<h1> Wrong interest calculations BaFin is taking action </h1>
<p> Status: 21.06.2021 5:08 p.m. </p>
<p><span id="more-27034"></span></p>
<p><strong> Premium savings contracts have long promised savers big money. However, in the low interest rate phase, many banks corrected the promised profit commitments downwards. BaFin is now intervening &#8211; in the interests of customers.</strong> </p>
<p> From Ursula Mayer, Mr </p>
<p>The Federal Financial Supervisory Authority BaFin obliges banks and savings banks to inform holders of premium savings contracts with a variable interest rate about ineffective interest rate adjustment clauses. To this end, the authority has published a general order &#8211; which is considered a sharp sword in the financial sector. The financial institutions must also explain to savers whether they have received too little interest as a result of the ineffective clauses. In this case, either back payments beckon or the banks can offer customers modified contracts with an effective interest rate adjustment clause. The changes apply retrospectively and also compensate for insufficiently paid interest in the past. According to BaFin, at least 247 banks and savings banks are affected. The total amount is open. </p>
<p> <a   class="teaser-absatz__link" href="https://en.spress.net/wp-content/plugins/wp-optimize-by-xtraffic/redirect/?gzv=H4sIAAAAAAACAx3HMQ6AIAwAwL90h8rqW7o00oARCaFFBuPfjU6Xu2HACtms6UpIOOf0xklUt8zDRyHca-EaCbVxl-o-LunWWZL8O1hVXFiCz3YWeF5zUOEcVAAAAA.." target="_blank" rel="nofollow noopener"> </p>
<p>
</p>
<p>
<p> <strong> </strong> May 14, 2019 </p>
<p> BGH judgment Sparkasse may terminate premium savers </p>
</p>
<p><p> The banks are entitled to dearly for the persistently low interest rates. But the judgment calls conditions.</p>
</p>
<p> </a></p>
<h2> So far, banks have stood across the board</h2>
<p> In the period between 1990 and 2010 in particular, the financial institutions offered a large number of premium savings contracts. These long-term contracts contain clauses that allow financial institutions to unilaterally change the guaranteed interest rate. They often did that in the low interest rate phase and cut savings rates, in some cases massively &#8211; at the expense of their customers. The Federal Court of Justice has meanwhile classified the clauses as ineffective.</p>
<p>BaFin Executive Director Thorsten Pötzsch refers to this in the general decree. He speaks of a &#8220;grievance&#8221; for consumers, which BaFin wants to remedy in terms of collective consumer protection. &#8220;We ensure that affected customers are comprehensively informed and legally treated,&#8221; says Pötzsch. Because for more than a year the supervisors have been trying to find a solution with the financial institutions in the interests of the customers, even at a round table &#8211; so far without success. The general decree shows that BaFin&#8217;s patience has come to an end. </p>
<p> <a   class="teaser-absatz__link" href="https://en.spress.net/wp-content/plugins/wp-optimize-by-xtraffic/redirect/?gzv=H4sIAAAAAAACAxXMMQ6AIAxA0buwC7pyFpaqFYjYmLZIovHu4vj-8B9TjTdJ9RQfXHCtNasQUWRJUO2KPWXWX5sGdyHPDHVJyMHNQDvSQBhB83Vnki45gTFT6Q8apnGySY9i3g8cBOUuaAAAAA.." target="_blank" rel="nofollow noopener"> </p>
<p>
</p>
<p>
<p> <strong> background</strong> 06/18/2021 </p>
<p> Negative interest on credit When it suddenly costs you to save </p>
</p>
<p><p> Since the beginning of the year, more than 170 banks have introduced negative interest rates for private customers.</p>
</p>
<p> </a></p>
<h2> Hundreds of thousands of customers affected</h2>
<p> &#8220;We are assuming that banks and, above all, savings banks have concluded hundreds of thousands of premium savings contracts nationwide,&#8221; says financial expert Andrea Heyer from the consumer center in Saxony. She and her team have specialized in recalculating such contracts. More than 7700 customers from all over Germany have already contacted us.</p>
<p>As the consumer advocates have calculated together with experts, the financial institutions have calculated the interest rates too low for years in almost all cases. As a rule, consumers were unable to understand how they set the variable interest rate. Often the financial houses have lowered interest rates too much, in too large interest rate steps downwards. &#8220;Depending on the case, those affected are entitled to additional payments of a few hundred to over 40,000 euros in individual cases,&#8221; says Heyer. In this respect, she welcomes the fact that BaFin is now intervening &#8211; that is an important signal. </p>
<p> <a   class="teaser-absatz__link" href="https://en.spress.net/wp-content/plugins/wp-optimize-by-xtraffic/redirect/?gzv=H4sIAAAAAAACAxXIOw6AIAwA0LuwA7J6FpaK5ZNgo7RIovHu6vjerbqaVRbZefbW2zGGEUjIHDJ0s-JXpcmvKN4maEBS8CrEuuKCxCc2LiFj65SQdIRDu8mZLFtVzwvbP_Y3XwAAAA.." target="_blank" rel="nofollow noopener"> </p>
<p>
</p>
<p>
<p> <strong> FAQ</strong> 02.12.2020 </p>
<p> Life insurer Guaranteed interest rate should drop drastically </p>
</p>
<p><p> The life insurers should lower their guaranteed interest rate significantly &#8211; to just 0.25 percent.</p>
</p>
<p> </a></p>
<h2> Suddenly it was 15,000 euros less</h2>
<p> Karina Rother from Frankfurt, for example, signed such a premium savings contract at Frankfurter Sparkasse in the 1990s and wanted to do something for her retirement with it. &#8220;The Sparkasse promised me that with a term of 25 years it would really be worth it for me,&#8221; says Rother. She promised the customer steadily rising interest rates and ever higher cash rewards.</p>
<p>Rother assumed that she would get around 77,000 euros in the end &#8211; as it was calculated in an advertising flyer. Suddenly it should be around 15,000 euros less. In the end, she agreed with the Sparkasse on an extra payment of around 4,000 euros &#8211; but, says Rother: &#8220;It annoys me that a public institute in particular causes such trouble, even though it is in the interests of the company &#8216;Joe Bloggs&#8217; should have in view. &#8220;When asked, the Sparkasse did not want to comment on the case because of banking secrecy. </p>
<p> <a   class="teaser-absatz__link" href="https://en.spress.net/wp-content/plugins/wp-optimize-by-xtraffic/redirect/?gzv=H4sIAAAAAAACAx3LMQ6AIBBE0bvQA9pyFppVViDiamCRROPdRbv5L5lbVGFEYD6Ksdrq1ppi8FjKHKAqh51i5q8WtnqJBHQhWV0OyEjSY3JAqT8krBy7TEArxp9Inpi3Hb81DqMKvCXxvF0ngFZzAAAA" target="_blank" rel="nofollow noopener"> </p>
<p>
</p>
<p>
<p> <strong> </strong> 05/10/2021 </p>
<p> For the eighth time in a row Germans again European Spar champions </p>
</p>
<p><p> According to a study, people in the euro area are as rich as never before.</p>
</p>
<p> </a></p>
<h2> Savings banks oriented towards the common good have a duty</h2>
<p> Julian Merzbacher, consumer protection expert of the citizens&#8217; movement Finanzwende, also sees the savings banks in particular as having an obligation to finally act and to approach customers on their own initiative. &#8220;It is a cheek that the public welfare-oriented institutes have so far mainly relied on the time factor and statutes of limitations when it comes to saving premiums&#8221;.</p>
<p>The general decree of BaFin also explicitly refers to contracts that have already been terminated. But the extent to which claims from customers are already statute-barred &#8211; or maybe not &#8211; is not a matter for BaFin, it says there, but the courts would have to clarify in case of doubt. </p>
<p> <a   class="teaser-absatz__link" href="https://en.spress.net/wp-content/plugins/wp-optimize-by-xtraffic/redirect/?gzv=H4sIAAAAAAACAxXLQQ7CMAwF0btk74Zue5Zs3ObXiQgGxY4igbg7ZTlPmk8YYQvF_WVbiinOORdngdlReCwZF9Xu_zo9xbMq6xuaovQBBQlaZm3XQcpHKdy8yh3VCSa0D82wDqnoQ4WkA0r7U7PReluX4o8Wvj8HR1f2hAAAAA.." target="_blank" rel="nofollow noopener"> </p>
<p>
</p>
<p>
<p> <strong> </strong> 05/05/2021 </p>
<p> Green investment Sustainability traffic light with weaknesses </p>
</p>
<p><p> The federal government wants to mark financial products with a &#8220;sustainability traffic light&#8221; in the future.</p>
</p>
<p> </a></p>
<h2> Big incomprehension among the banks</h2>
<p> However, the credit institutions now have four weeks to appeal against the general ruling. This is currently being checked, according to the Deutsche Kreditwirtschaft, the umbrella association for the banking industry. &#8220;It is astonishing that the Federal Financial Supervisory Authority is pre-empting the courts,&#8221; said a written statement.</p>
<p>Because there is still another judgment pending at the Federal Court of Justice, according to which specific criteria banks have to adjust interest rates in long-term savings contracts. When this decision will be announced is not yet known &#8211; consumer advocates are expecting the verdict in the fall. And of course the German banking industry wants to take this into account, according to its own statements. </p>
<p> <a   class="teaser-absatz__link" href="https://en.spress.net/wp-content/plugins/wp-optimize-by-xtraffic/redirect/?gzv=H4sIAAAAAAACAxXISw7CMAwFwLtk74Rue5Zs3PTlo4JBjqMgUO9eWM583XCrq2avvsYQw5zTGxf0nioPv-NXTe2vbDHkJiwfSAxFBwTEhzUIoReCZdr5TYl1ewqZcjqgtNwWX-1xd-cFUJkfnWwAAAA." target="_blank" rel="nofollow noopener"> </p>
<p>
</p>
<p>
<p> <strong> </strong> March 31, 2021 </p>
<p> Sustainable investments Green stocks bring more profit </p>
</p>
<p><p> According to a new study, green shares can be used to make good money on the stock market. </p>
</p>
<p> </a></p>
<h2> Don&#8217;t just accept comparison offers</h2>
<p> But just waiting until then is not an option, according to BaFin. After all, it is uncertain when a decision by the Federal Court of Justice can be expected, according to the general ruling. As a result, the situation is unnecessarily prolonged for the financial supervisors, and consumers should now be informed urgently.</p>
<p>With a view to the general ruling, consumers do not have to do anything at first. However, you should pay attention to whether you will soon receive mail from your house bank regarding premium savings contracts or not. If comparative offers are made, consumer advocate Heyer recommends having them checked so that no saver is taken advantage of</p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">27034</post-id>	</item>
		<item>
		<title>7 fatal mistakes when applying sunscreen that need to be corrected immediately</title>
		<link>https://en.spress.net/7-fatal-mistakes-when-applying-sunscreen-that-need-to-be-corrected-immediately/</link>
		
		<dc:creator><![CDATA[editor]]></dc:creator>
		<pubDate>Fri, 21 May 2021 06:05:07 +0000</pubDate>
				<category><![CDATA[Beauty]]></category>
		<category><![CDATA[Apply]]></category>
		<category><![CDATA[Applying]]></category>
		<category><![CDATA[corrected]]></category>
		<category><![CDATA[fatal]]></category>
		<category><![CDATA[Harmful]]></category>
		<category><![CDATA[Hot sun]]></category>
		<category><![CDATA[Hurt]]></category>
		<category><![CDATA[immediately]]></category>
		<category><![CDATA[Mistake]]></category>
		<category><![CDATA[mistakes]]></category>
		<category><![CDATA[New Sun]]></category>
		<category><![CDATA[PABA]]></category>
		<category><![CDATA[Plus]]></category>
		<category><![CDATA[Protect the skin]]></category>
		<category><![CDATA[Repair]]></category>
		<category><![CDATA[Skin]]></category>
		<category><![CDATA[SPF]]></category>
		<category><![CDATA[SPF 20]]></category>
		<category><![CDATA[SPF 30]]></category>
		<category><![CDATA[Sunscreen]]></category>
		<category><![CDATA[Ultraviolet ray]]></category>
		<category><![CDATA[UVA]]></category>
		<category><![CDATA[UVB]]></category>
		<category><![CDATA[UVB rays]]></category>
		<guid isPermaLink="false">https://en.spress.net/7-fatal-mistakes-when-applying-sunscreen-that-need-to-be-corrected-immediately/</guid>

					<description><![CDATA[Using the wrong sunscreen can damage your skin even with the best products. Not using enough sunscreen Applying too little sunscreen leads to a lower SPF that prevents the skin from receiving optimal protection from UV rays. As recommended, the amount of sunscreen the size of the palm is enough for the body. As for [&#8230;]]]></description>
										<content:encoded><![CDATA[<p><strong>Using the wrong sunscreen can damage your skin even with the best products.</strong><br />
<span id="more-16823"></span> Not using enough sunscreen</p>
<p> Applying too little sunscreen leads to a lower SPF that prevents the skin from receiving optimal protection from UV rays. As recommended, the amount of sunscreen the size of the palm is enough for the body. As for the face, you should apply a dime-sized amount of sunscreen. Don&#8217;t reapply sunscreen often <img fifu-featured="1" decoding="async" loading="lazy" src="https://photo-baomoi.zadn.vn/w700_r1/2021_05_20_296_38907605/38f499f883ba6ae433ab.jpg" width="625" height="411"> <em> To protect your skin, reapply sunscreen every 2-3 hours. (Illustration)</em> Sunscreen, whether applied or sprayed, degrades after 2 hours of use in the sun. If exposed to water or sweat a lot, the above time will be shortened. Therefore, it is necessary to regularly reapply sunscreen. When reapplying sunscreen, you can use makeup remover to remove the previous layer. If you&#8217;re wearing makeup, use a powder sunscreen to reapply. Skip important areas Many women think that only the skin exposed to the sun must apply sunscreen without knowing that UV rays can penetrate clothes and different layers of thick and thin fabrics. If sunscreen is not applied to the entire body, many other areas of skin can still be damaged as usual. In addition, note two places people often do not pay attention to protect when going out in the sun: eyelids and lips. The lips are especially vulnerable because they don&#8217;t have a lot of melanocytes, a protective pigment responsible for giving color to skin, hair and eyes. The more hydrated your lips are, the easier it is for UV rays to penetrate deeper into unprotected skin. For lips, you can use lip balm with SPF over 30. Do not follow instructions for use For chemical sunscreen to be effective, it needs to be applied to the skin at least 20 minutes before going outside because the skin needs time to absorb the protective ingredients. It is recommended to apply evenly and thoroughly on the skin before wearing clothes to avoid any traces or stains of cream on the clothes. Particularly for products with 2 physical sunscreen ingredients &#8211; titanium oxide and zinc oxide &#8211; will work immediately after application. So with a physical sunscreen, you don&#8217;t have to wait for the sunscreen ingredients inside to take effect. Use opened sunscreen for a long time When unopened, sunscreen usually has a shelf life of about 2-3 years. However, once used, this time is reduced to about 6 months. You should not use sunscreen that has expired, has a change in texture, color or scent because it can cause allergies and damage to the skin. Do not pay attention to the spectrum index on sunscreen Many sunscreens only work against UVB rays, the cause of sunburn. Meanwhile, UVA rays also bring many harmful effects. Carrying a longer wavelength than UVB rays, UVA rays penetrate deeper into the skin, destroying collagen structures and leading to skin aging. For maximum skin protection, look for sunscreens that have broad-spectrum formulas (on the packaging that say &#8220;broad-spectrum&#8221;) that block UVA and UVB rays. For sunscreens that use the PA character, choose a product that has the PA character with plus signs after +++ or more. Using sunscreen that is not suitable for your skin Sunscreen only works when you choose the right product, suitable for your skin characteristics. Should choose a sunscreen with an SPF of 20 &#8211; 30 for light skin, an SPF of less than 20 for dark skin, if you want to increase protection in the harsh sun, only use a sunscreen with SPF 30 50 is the best fit. People with acne-prone skin should use the spray form. This type both protects the skin and unclogs the pores, helping the skin not to be blocked by dust and sweat. Sensitive skin, prone to allergies should choose sunscreen that does not contain paraaminobenzoic acid (PABA). Like other cosmetics, improper use of sunscreen is not only ineffective, it can even cause unfortunate damage to the skin. If you are making the above mistakes, you need to correct them immediately to have smooth, healthy skin this summer. <strong> Minh Hoa</strong> <em> (th)</em></p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">16823</post-id>	</item>
		<item>
		<title>Spelling, common sense, grammar, and reasoning errors can be corrected. Yuncong proposes a BART-based semantic error correction method</title>
		<link>https://en.spress.net/spelling-common-sense-grammar-and-reasoning-errors-can-be-corrected-yuncong-proposes-a-bart-based-semantic-error-correction-method/</link>
		
		<dc:creator><![CDATA[editor]]></dc:creator>
		<pubDate>Sun, 18 Apr 2021 06:08:07 +0000</pubDate>
				<category><![CDATA[Tech]]></category>
		<category><![CDATA[BARTbased]]></category>
		<category><![CDATA[common]]></category>
		<category><![CDATA[corrected]]></category>
		<category><![CDATA[correction]]></category>
		<category><![CDATA[error]]></category>
		<category><![CDATA[errors]]></category>
		<category><![CDATA[grammar]]></category>
		<category><![CDATA[Method]]></category>
		<category><![CDATA[proposes]]></category>
		<category><![CDATA[Reasoning]]></category>
		<category><![CDATA[semantic]]></category>
		<category><![CDATA[sense]]></category>
		<category><![CDATA[Spelling]]></category>
		<category><![CDATA[Yuncong]]></category>
		<guid isPermaLink="false">https://en.spress.net/spelling-common-sense-grammar-and-reasoning-errors-can-be-corrected-yuncong-proposes-a-bart-based-semantic-error-correction-method/</guid>

					<description><![CDATA[Heart of the Machine released Heart of the Machine Editorial Department Yuncong Technology Speech Group proposed a semantic error correction technical solution based on the BART pre-trained model. It can not only correct common spelling errors in ASR data, but also correct common sense errors, grammatical errors, and even some that require reasoning. Errors are [&#8230;]]]></description>
										<content:encoded><![CDATA[<p>Heart of the Machine released</p>
<p> <strong> Heart of the Machine Editorial Department</strong> Yuncong Technology Speech Group proposed a semantic error correction technical solution based on the BART pre-trained model. It can not only correct common spelling errors in ASR data, but also correct common sense errors, grammatical errors, and even some that require reasoning. Errors are corrected. In recent years, with the development of automatic speech recognition (ASR) technology, the recognition accuracy has been greatly improved. However, there are still some errors that are very obvious to humans in the ASR transcribing results. We don&#8217;t need to listen to the audio, we can find out only by observing the transcribed text. The correction of such errors often requires some common sense and grammatical knowledge, and even the ability of reasoning. Thanks to the recent development of unsupervised pre-training language model technology, error correction models based on plain text features can effectively solve such problems. The semantic error correction system proposed in this paper is divided into two modules: encoder and decoder. The encoder focuses on understanding the semantics of the output text of the ASR system, and the design of the decoder focuses on the use of standardized vocabulary to re-express. <img fifu-featured="1" decoding="async" class="content-picture" src="https://inews.gtimg.com/newsapp_bt/0/13412876667/1000"> Link to the paper: https://arxiv.org/abs/2104.05507 <strong> introduction</strong> Text error correction is an important method to improve the accuracy of ASR recognition. Common text error correction includes grammatical error correction and spelling error correction. Because the error distribution of the ASR system transfer is quite different from the above error distribution, these models are often not suitable for direct use in the ASR system.Here, Yuncong Technology Speech Group proposed a pre-training model based on BART [1] The Semantic Error Correction (SC) technical solution can not only correct common spelling errors in ASR data, but also correct some common sense errors, grammatical errors, and even some errors that require reasoning. In our experiments with 10,000 hours of data, the error correction model can relatively reduce the error rate (CER) based on 3gram decoding results by 21.7%, achieving an effect similar to RNN rescoring. Using error correction on the basis of RNN re-scoring, a further 6.1% relative reduction in CER can be achieved. The error analysis results show that the actual error correction effect is better than the CER indicator shows. <strong> model</strong> <strong> 1) ASR semantic error correction system design</strong> The ASR semantic error correction process is shown in Figure 1. The semantic error correction module can be directly applied to the first pass of the decoding result as an alternative to the re-scoring module. In addition, it can also be connected to the re-scoring model to further improve the recognition accuracy. <img decoding="async" class="content-picture" src="https://inews.gtimg.com/newsapp_bt/0/13412876668/1000"> Figure1 ASR system with integrated semantic error correction model <strong> 2) Baseline ASR system</strong> The baseline acoustic model structure selected by the author is pyramidal FSMN[2], Training on 10,000 hours of Mandarin audio data. The WFST used in the first pass of decoding is composed of 3gram language model, pronunciation dictionary, dual phoneme structure and HMM structure. 4grams and RNNs are used in the rescoring, and the training data is the reference text corresponding to these audios.Acoustic model and language model use Kaldi tools [3] training. <strong> 3) Semantic error correction model structure</strong> The semantic error correction model proposed by the researcher is based on Transformer [4]Structure, it contains 6 layers of encoder layer and 6 layers of decoder layer, and the modeling unit is token. In the training process using the Teacher forcing method, the text output by the ASR is input to the input side of the model, and the corresponding reference text is input to the output side of the model. The input embedding matrix and the output embedding matrix are used for encoding, and the cross entropy is used as the loss function. In the semantic error correction model inference process, beam search is used for decoding, and the beam width is set to 3. <img decoding="async" class="content-picture" src="https://inews.gtimg.com/newsapp_bt/0/13412876669/1000"> Figure 2 Semantic error correction model based on Transformer <strong> experiment</strong> <strong> 1. Error correction training data preparation</strong> The training set of our baseline ASR model is 10,000 hours of Mandarin speech data, which contains about 800 transliterated texts. The side test set consists of 5 hours of mixed voice data, including Aishell, Thchs30 and other side test sets. In order to fully sample the error distribution identified by the ASR system, we adopted the following techniques when constructing the error correction model training data set: Use a weak acoustic model to generate error correction training data. Here, 10% of the speech data is used to train a small acoustic model separately to generate training data; Add disturbance to the MFCC feature, and randomly multiply the MFCC feature by a coefficient between 0.8 and 1.2; Input the noisy features into the weak acoustic model, take the first 20 results of beam search, and filter the samples according to the typos rate threshold. Finally, we pair the filtered decoding results with their corresponding reference texts as the error correction model training data. By decoding the full audio data and setting the threshold at 0.3, we obtained about 30 million error correction sample pairs. <strong> 2. Input and output presentation layer</strong> In the semantic error correction model, the input and output text use the same dictionary. But the typo in the input text contains more semantics than its standard usage, while the output text only uses the standard words to express. Therefore, the independent representation of the tokens on the input and output sides is more in line with the needs of error correction tasks. The results in Table 1 prove our inference. The experimental results show that when the input and output embedded matrix share the weight, the error correction model will bring negative effects. When the input and output tokens are represented independently, the CER of the system can be reduced by 5.01%. <img decoding="async" class="content-picture" src="https://inews.gtimg.com/newsapp_bt/0/13412876725/1000"> <strong> 3. BART vs BERT initialization</strong> Here, the researcher pre-trains the language model technology, and transfers the semantic knowledge learned from the large-scale corpus to the error correction scene, so that the error correction model obtains better robustness and universality on a relatively small training set.化性. We compare random initialization, BERT[5]Initialization and BART[1]Initialization method. During the initialization process, because the BART pre-training task and model structure are the same as Transformer, the parameters can be reused directly.In BERT initialization, both the encoder and decoder of Transformer are applicable to the first 6-layer network parameters of BERT[6]. <img decoding="async" class="content-picture" src="https://inews.gtimg.com/newsapp_bt/0/13412876726/1000"> The results in Table 2 show that BART initialization can reduce the typo rate of the baseline ASR by 21.7%, but the improvement of the BERT-initialized model relative to the random initialization model is very limited. We push this may be because the structure of the BERT and the semantic error correction model and the training target are too different, and the knowledge has not been effectively transferred. In addition, the error correction model corrects the output of the language model after re-scoring, and the recognition rate can be further improved. Compared with 4grams, RNN re-scoring results, CER can be relatively reduced by 21.1% and 6.1%, respectively. <img decoding="async" class="content-picture" src="https://inews.gtimg.com/newsapp_bt/0/13412876727/1000"> <strong> 4. Error correction model vs large language model</strong> Generally speaking, the ASR system uses a larger language model to obtain better recognition results, but it also consumes more memory resources and reduces decoding efficiency. Here, we add a large number of crawlers or open source plain text corpus on the basis of the speech data reference text, and newly train 3gram, 4gram and RNN language models, and call them the big language model. The one used in the baseline ASR system is called a small model. By comparison, it is found that the recognition accuracy of adding error correction on the basis of a small model surpasses the effect of using a large model alone. In addition, by using semantic error correction on the basis of a large model, the recognition rate can be further improved. <img decoding="async" class="content-picture" src="https://inews.gtimg.com/newsapp_bt/0/13412876792/1000"> Some examples of error correction are as follows: <img decoding="async" class="content-picture" src="https://inews.gtimg.com/newsapp_bt/0/13412876793/1000"> <strong> 5. Error analysis</strong> In error analysis of 300 examples of failed corrections, we found that the actual effect of semantic error correction is significantly better than the CER indicator evaluation. About 40% of errors hardly affect semantics, for example, some transliterated foreign names or place names There are many ways of expression, some personal pronouns lack context, which will cause the mixed use of &#8220;her, other, and other&#8221;, and some are substitutions of modal particles that do not affect semantics. In addition, 30% of errors are not suitable for correction based on pure text features due to insufficient contextual information. The remaining 30% of errors are caused by insufficient semantic understanding or expressive ability of the semantic error correction model. <img decoding="async" class="content-picture" src="https://inews.gtimg.com/newsapp_bt/0/13412876795/1000"> <strong> to sum up</strong> This paper proposes a BART-based semantic error correction model, which has good generalization and consistently improves the recognition results of multiple ASR systems. In addition, the researchers verified the importance of independent representation of input and output in the task of text error correction through experiments. In order to more fully sample the ASR system identification error distribution, this paper proposes a simple and effective error correction data generation strategy. Finally, although the semantic error correction method we proposed has achieved certain benefits, there is still room for optimization, such as: 1. The introduction of acoustic features helps the model identify whether there are errors in the text and reduces the false touch rate. 2. Introducing more contextual information can eliminate some semantic ambiguities or missing information in the text. 3. Adapt to vertical business scenarios to improve the recognition accuracy of some professional terms. references [1]M. Lewis et al., “BART: Denoising Sequence-to-Sequence Pre-training for Natural Language Generation, Translation, and Comprehension,” 2019, [Online]. Available: http://arxiv.org/abs/1910.13461. [2]X. Yang, J. Li, and X. Zhou, “A novel pyramidal-FSMN architecture with lattice-free MMI for speech recognition,” vol. 1, Oct. 2018, [Online]. Available: http://arxiv.org/abs/1810.11352. [3]D. Povey et al., “The Kaldi Speech Recognition Toolkit,” IEEE Signal Process. Soc., vol. 35, no. 4, p. 140, 2011. [5]J. Devlin, M.-W. Chang, K. Lee, and K. Toutanova, “BERT: Pre-training of Deep Bidirectional Transformers for Language Understanding,” 2018, [Online]. Available: http://arxiv.org/abs/1810.04805. [6]O. Hrinchuk, M. Popova, and B. Ginsburg, &#8220;Correction of Automatic Speech Recognition with Transformer Sequence-to-sequence Model,&#8221; ICASSP 2020-2020 IEEE Int. Conf. Acoust. Speech Signal Process., pp. 7074C7078, Oct . 2019, [Online]. Available: http://arxiv.org/abs/1910.10697. <strong> Build new, see wisdom &#8211; 2021 Amazon Cloud Technology AI</strong> <strong> Online conference</strong> April 22, 14:00-18:00 Why do so many machine learning loads choose Amazon Cloud Technology? How to achieve large-scale machine learning and enterprise digital transformation? &#8220;Building New · Seeing Wisdom-2021 Amazon Cloud Technology AI Online Conference&#8221; is led by Alex Smola, vice president of global artificial intelligence technology and outstanding scientist of Amazon Cloud Technology, and Gu Fan, general manager of Amazon Cloud Technology Greater China Product Department, and more than 40 heavyweights Guests will give you an in-depth analysis of the innovation culture of Amazon cloud technology in the keynote speech and 6 major conferences, and reveal how AI/ML can help companies accelerate innovation. Session 1: Amazon Machine Learning Practice Revealed Session 2: Artificial Intelligence Empowers Digital Transformation of Enterprises Session 3: The Way to Realize Large-scale Machine Learning Session 4: AI services help the Internet to innovate rapidly Session 5: Open Source and Frontier Trends Sub-venue 6: Intelligent ecology of win-win cooperation <strong> Which topic are you more interested in in the 6 major conference venues?</strong></p>
]]></content:encoded>
					
		
		
		<post-id xmlns="com-wordpress:feed-additions:1">4203</post-id>	</item>
	</channel>
</rss>