title: Configuration Space Exploration for Digital Printing Systems

abstract: Within the printing industry, much of the variety in printed applications comes from the variety in finishing. Finishing comprises the processing of sheets of paper after being printed, e.g. to form books. The configuration space of finishers, i.e. all possible configurations given the available features and hardware capabilities, are large. Current control software minimally assists operators in finding useful configurations. Using a classical modelling and integration approach to support a variety of configuration spaces is suboptimal with respect to operatability, development time, and maintenance burden. In this paper, we explore the use of a modeling language for finishers to realize optimizing decision making over configuration parameters in a systematic way and to reduce development time by generating control software from models. We present CSX, a domain-specific language for high-level declarative specification of finishers that supports specification of the configuration parameters and the automated exploration of the configuration space of finishers. The language serves as an interface to constraint solving, i.e., we use low-level SMT constraint solving to find configurations for high-level specifications. We present a denotational semantics that expresses a translation of CSX specifications to SMT constraints. We describe the implementation of the CSX compiler and the CSX programming environment (IDE), which supports well-formedness checking, inhabitance checking, and interactive configuration space exploration. We evaluate CSX by modelling two realistic finishers. Benchmarks show that CSX has practical performance (<1s) for several scenarios of configuration space exploration.


title: Unified formulation of interfacial magnonic pumping from non-collinear magnets

abstract: We establish a general formulation for spin current pumped by magnons at the interface between a normal metal and a magnetic insulator, valid for any non-collinear magnetic configuration in the linear spin wave regime. This current is generated by driving the system in a non-equilibrium state, covering setups such as thermal spin injection (spin Seebeck effect) or spin voltage by irradiation of the insulator (spin pumping). We illustrate the formula in the special case of a honeycomb topological ferromagnet, for simplicity, and cover both the spin Seebeck and spin-pumping setups. We show how the topological parameters influence the spin current and propose a way to obtain a contribution mainly from the topological edge magnons in the spin pumping case.


title: The Price Impact of Generalized Order Flow Imbalance

abstract: Order flow imbalance can explain short-term changes in stock price. This paper considers the change of non-minimum quotation units in real transactions, and proposes a generalized order flow imbalance construction method to improve Order Flow Imbalance (OFI) and Stationarized Order Flow Imbalance (log-OFI). Based on the high-frequency order book snapshot data, we conducted an empirical analysis of the CSI 500 constituent stocks. In order to facilitate the presentation, we selected 10 stocks for comparison. The two indicators after the improvement of the generalized order flow imbalance construction method both show a better ability to explain changes in stock prices. Especially Generalized Stationarized Order Flow Imbalance (log-GOFI), using a linear regression model, on the time scales of 30 seconds, 1 minute, and 5 minutes, the average R-squared out of sample compared with Order Flow Imbalance (OFI) 32.89%, 38.13% and 42.57%, respectively increased to 83.57%, 85.37% and 86.01%. In addition, we found that the interpretability of Generalized Stationarized Order Flow Imbalance (log-GOFI) showed stronger stability on all three time scales.


title: Sizes of Lensed Lower-luminosity z=4-8 Galaxies from the Hubble Frontier Field Program

abstract: We constrain the rest-UV size-luminosity relation for star-forming galaxies at z~4 and z~6, 7, and 8 identified behind clusters from the Hubble Frontier Fields (HFF) program. The size-luminosity relation is key to deriving accurate luminosity functions (LF) for faint galaxies. Making use of the latest lensing models and full data set for these clusters, lensing-corrected sizes and luminosities are derived for 68 z~4, 184 z~6, 93 z~7, and 53 z~8 galaxies. We show that size measurements can be reliably measured up to linear magnifications of 30x, where the lensing models are well calibrated. The sizes we measure span a >1-dex range, from <50 pc to >~500 pc. Uncertainties are based on both the formal fit errors and systematic differences between the public lensing models. These uncertainties range from ~20 pc for the smallest sources to 50 pc for the largest. Using a forward-modeling procedure to model the impact of incompleteness and magnification uncertainties, we characterize the size-luminosity relation at both z~4 and z~6-8. We find that the source sizes of star-forming galaxies at z~4 and z~6-8 scale with luminosity L as L^{0.54\pm0.08} and L^{0.40+/-0.04}, respectively, such that lower luminosity (>~-18 mag) galaxies are smaller than expected from extrapolating the size-luminosity relation at high luminosities (<~-18 mag). The new evidence for a steeper size-luminosity relation (3 sigma) adds to earlier evidence for small sizes based on the prevalence of highly magnified galaxies in high shear regions, theoretical arguments against upturns in the LFs, and other independent determinations of the size-luminosity relation from the HFF clusters.


title: A hyperbolic analogue of the Atiyah-Hitchin manifold

abstract: The Atiyah-Hitchin manifold is the moduli space of parity inversion symmetric charge two SU(2) monopoles in Euclidean space. Here a hyperbolic analogue is presented, by calculating the boundary metric on the moduli space of parity inversion symmetric charge two SU(2) monopoles in hyperbolic space. The calculation of the metric is performed using a twistor description of the moduli space and the result is presented in terms of standard elliptic integrals.


title: Bayesian Estimation Approach for Linear Regression Models with Linear Inequality Restrictions

abstract: Univariate and multivariate general linear regression models, subject to linear inequality constraints, arise in many scientific applications. The linear inequality restrictions on model parameters are often available from phenomenological knowledge and motivated by machine learning applications of high-consequence engineering systems (Agrell, 2019; Veiga and Marrel, 2012). Some studies on the multiple linear models consider known linear combinations of the regression coefficient parameters restricted between upper and lower bounds. In the present paper, we consider both univariate and multivariate general linear models subjected to this kind of linear restrictions. So far, research on univariate cases based on Bayesian methods is all under the condition that the coefficient matrix of the linear restrictions is a square matrix of full rank. This condition is not, however, always feasible. Another difficulty arises at the estimation step by implementing the Gibbs algorithm, which exhibits, in most cases, slow convergence. This paper presents a Bayesian method to estimate the regression parameters when the matrix of the constraints providing the set of linear inequality restrictions undergoes no condition. For the multivariate case, our Bayesian method estimates the regression parameters when the number of the constrains is less than the number of the regression coefficients in each multiple linear models. We examine the efficiency of our Bayesian method through simulation studies for both univariate and multivariate regressions. After that, we illustrate that the convergence of our algorithm is relatively faster than the previous methods. Finally, we use our approach to analyze two real datasets.


title: An improved technique for measuring plasma density to high frequencies on the Parker Solar Probe

abstract: The correlation between the plasma density measured in space and the surface potential of an electrically conducting satellite body with biased electric field detectors has been recognized and used to provide density proxies. However, for Parker Solar Probe, this correlation has not produced quantitative density estimates over extended periods of time because it depends on the energy dependent exponential variation of the photoemission spectrum, the electron temperature, the ratio of the biased surface area to the conducting spacecraft surface area, the spacecraft secondary or thermal emission, the spacecraft distance from the Sun, etc. In this paper the density as a function of time and frequency to frequencies as high as the electron gyrofrequency is determined through least squares fits of a function of the spacecraft potential to the plasma density measured on the Parker Solar Probe. This function allows correction for the many effects on the spacecraft potential other than that due to the plasma density. Some examples of plasma density obtained from this procedure are presented.


title: Gradient Regularization of Newton Method with Bregman Distances

abstract: In this paper, we propose a first second-order scheme based on arbitrary non-Euclidean norms, incorporated by Bregman distances. They are introduced directly in the Newton iterate with regularization parameter proportional to the square root of the norm of the current gradient. For the basic scheme, as applied to the composite optimization problem, we establish the global convergence rate of the order $O(k^{-2})$ both in terms of the functional residual and in the norm of subgradients. Our main assumption on the smooth part of the objective is Lipschitz continuity of its Hessian. For uniformly convex functions of degree three, we justify global linear rate, and for strongly convex function we prove the local superlinear rate of convergence. Our approach can be seen as a relaxation of the Cubic Regularization of the Newton method, which preserves its convergence properties, while the auxiliary subproblem at each iteration is simpler. We equip our method with adaptive line search procedure for choosing the regularization parameter. We propose also an accelerated scheme with convergence rate $O(k^{-3})$, where $k$ is the iteration counter.


title: The artificial synesthete: Image-melody translations with variational autoencoders

abstract: Abstract This project presents a system of neural networks to translate between images and melodies. Autoencoders compress the information in samples to abstract representation. A translation network learns a set of correspondences between musical and visual concepts from repeated joint exposure. The resulting "artificial synesthete" generates simple melodies inspired by images, and images from music. These are novel interpretation (not transposed data), expressing the machine' perception and understanding. Observing the work, one explores the machine's perception and thus, by contrast, one's own.


title: Reinforcement Learning for Navigation of Mobile Robot with LiDAR

abstract: This paper presents a technique for navigation of mobile robot with Deep Q-Network (DQN) combined with Gated Recurrent Unit (GRU). The DQN integrated with the GRU allows action skipping for improved navigation performance. This technique aims at efficient navigation of mobile robot such as autonomous parking robot. Framework for reinforcement learning can be applied to the DQN combined with the GRU in a real environment, which can be modeled by the Partially Observable Markov Decision Process (POMDP). By allowing action skipping, the ability of the DQN combined with the GRU in learning key-action can be improved. The proposed algorithm is applied to explore the feasibility of solution in real environment by the ROS-Gazebo simulator, and the simulation results show that the proposed algorithm achieves improved performance in navigation and collision avoidance as compared to the results obtained by DQN alone and DQN combined with GRU without allowing action skipping.


title: Does constituency analysis enhance domain-specific pre-trained BERT models for relation extraction?

abstract: Recently many studies have been conducted on the topic of relation extraction. The DrugProt track at BioCreative VII provides a manually-annotated corpus for the purpose of the development and evaluation of relation extraction systems, in which interactions between chemicals and genes are studied. We describe the ensemble system that we used for our submission, which combines predictions of fine-tuned bioBERT, sciBERT and const-bioBERT models by majority voting. We specifically tested the contribution of syntactic information to relation extraction with BERT. We observed that adding constituentbased syntactic information to BERT improved precision, but decreased recall, since relations rarely seen in the train set were less likely to be predicted by BERT models in which the syntactic information is infused. Our code is available online [https://github.com/Maple177/drugprot-relation-extraction].


title: Mixed Deffuant Dynamics

abstract: The original Deffuant model consists of a finite number of agents whose opinion is a number in $[0,1]$. Two socially connected agents are uniformly randomly selected at each time step and approach each other at a rate $\mu\in [0,1/2]$ if and only if their opinions differ by at most some confidence threshold $\epsilon>0$. In this paper, we consider a variant of the Deffuant model, namely the mixed model, where the convergence parameter $\mu$ and the social relationship can vary over time. We investigate circumstances under which asymptotic stability holds or a consensus can be achieved. Also, we derive a nontrivial lower bound for the probability of consensus which is independent of the number of agents.


title: Simultaneous measurements of nuclear spin heat capacity, temperature and relaxation in GaAs microstructures

abstract: Heat capacity of the nuclear spin system (NSS) in GaAs-based microstructures has been shown to be much greater than expected from dipolar coupling between nuclei, thus limiting the efficiency of NSS cooling by adiabatic demagnetization. It was suggested that quadrupole interaction induced by some small residual strain could provide this additional reservoir for the heat storage. We check and validate this hypothesis by combining nuclear spin relaxation measurements with adiabatic remagnetization and nuclear magnetic resonance experiments, using electron spin noise spectroscopy as a unique tool for detection of nuclear magnetization. Our results confirm and quantify the role of the quadrupole splitting in the heat storage within NSS and provide additional insight into fundamental, but still actively debated relation between a mechanical strain and the resulting electric field gradients in GaAs.


title: Automap: Towards Ergonomic Automated Parallelism for ML Models

abstract: The rapid rise in demand for training large neural network architectures has brought into focus the need for partitioning strategies, for example by using data, model, or pipeline parallelism. Implementing these methods is increasingly supported through program primitives, but identifying efficient partitioning strategies requires expensive experimentation and expertise. We present the prototype of an automated partitioner that seamlessly integrates into existing compilers and existing user workflows. Our partitioner enables SPMD-style parallelism that encompasses data parallelism and parameter/activation sharding. Through a combination of inductive tactics and search in a platform-independent partitioning IR, automap can recover expert partitioning strategies such as Megatron sharding for transformer layers.


title: Cosmological and astrophysical results exploiting magnification bias with high-z sub-millimetre galaxies

abstract: The high-z submillimeter galaxies (SMGs) can be used as background sample for gravitational lensing studies thanks to their magnification bias, which can manifest itself through a non-negligible measurement of the cross-correlation function between a background and a foreground source sample with non-overlapping redshift distributions. In particular, the choice of SMGs as background sample enhances the cross-correlation signal so as to provide an alternative and independent observable for cosmological studies regarding the probing of mass distribution. In particular the magnification bias can be exploited in order to constrain the free astrophysical parameters of a Halo Occupation Distribution model and some of the main cosmological parameters. Urged by the improvements obtained when adopting a pseudo-tomographic analysis, It has been adopted a tomographic set-up to explore not only a $\Lambda$CDM scenario, but also the possible time evolution of the dark energy density in the $\omega_0$CDM and $\omega_0\omega_a$CDM frameworks.


title: Two Wrongs Don't Make a Right: Combating Confirmation Bias in Learning with Label Noise

abstract: Noisy labels damage the performance of deep networks. For robust learning, a prominent two-stage pipeline alternates between eliminating possible incorrect labels and semi-supervised training. However, discarding part of noisy labels could result in a loss of information, especially when the corruption has a dependency on data, e.g., class-dependent or instance-dependent. Moreover, from the training dynamics of a representative two-stage method DivideMix, we identify the domination of confirmation bias: pseudo-labels fail to correct a considerable amount of noisy labels, and consequently, the errors accumulate. To sufficiently exploit information from noisy labels and mitigate wrong corrections, we propose Robust Label Refurbishment (Robust LR) a new hybrid method that integrates pseudo-labeling and confidence estimation techniques to refurbish noisy labels. We show that our method successfully alleviates the damage of both label noise and confirmation bias. As a result, it achieves state-of-the-art performance across datasets and noise types, namely CIFAR under different levels of synthetic noise and Mini-WebVision and ANIMAL-10N with real-world noise.


title: Closed-Loop Nash Competition for Liquidity

abstract: We study a multi-player stochastic differential game, where agents interact through their joint price impact on an asset that they trade to exploit a common trading signal. In this context, we prove that a closed-loop Nash equilibrium exists if the price impact parameter is small enough. Compared to the corresponding open-loop Nash equilibrium, both the agents' optimal trading rates and their performance move towards the central-planner solution, in that excessive trading due to lack of coordination is reduced. However, the size of this effect is modest for plausible parameter values.


title: DANets: Deep Abstract Networks for Tabular Data Classification and Regression

abstract: Tabular data are ubiquitous in real world applications. Although many commonly-used neural components (e.g., convolution) and extensible neural networks (e.g., ResNet) have been developed by the machine learning community, few of them were effective for tabular data and few designs were adequately tailored for tabular data structures. In this paper, we propose a novel and flexible neural component for tabular data, called Abstract Layer (AbstLay), which learns to explicitly group correlative input features and generate higher-level features for semantics abstraction. Also, we design a structure re-parameterization method to compress the learned AbstLay, thus reducing the computational complexity by a clear margin in the reference phase. A special basic block is built using AbstLays, and we construct a family of Deep Abstract Networks (DANets) for tabular data classification and regression by stacking such blocks. In DANets, a special shortcut path is introduced to fetch information from raw tabular features, assisting feature interactions across different levels. Comprehensive experiments on seven real-world tabular datasets show that our AbstLay and DANets are effective for tabular data classification and regression, and the computational complexity is superior to competitive methods. Besides, we evaluate the performance gains of DANet as it goes deep, verifying the extendibility of our method. Our code is available at https://github.com/WhatAShot/DANet.


title: Hyperstyle: A Tool for Assessing the Code Quality of Solutions to Programming Assignments

abstract: In software engineering, it is not enough to simply write code that only works as intended, even if it is free from vulnerabilities and bugs. Every programming language has a style guide and a set of best practices defined by its community, which help practitioners to build solutions that have a clear structure and therefore are easy to read and maintain. To introduce assessment of code quality into the educational process, we developed a tool called Hyperstyle. To make it reflect the needs of the programming community and at the same time be easily extendable, we built it upon several existing professional linters and code checkers. Hyperstyle supports four programming languages (Python, Java, Kotlin, and Javascript) and can be used as a standalone tool or integrated into a MOOC platform. We have integrated the tool into two educational platforms, Stepik and JetBrains Academy, and it has been used to process about one million submissions every week since May 2021.


title: Homointerface planar Josephson junction based on inverse proximity effect

abstract: The quality of a superconductor-normal metal-superconductor Josephson junction (JJ) depends crucially on the transparency of the superconductor-normal metal (S/N) interface. We demonstrate a technique for fabricating planar JJs with perfect S/N interfaces. The technique utilizes a strong inverse proximity effect discovered in Al/V$_5$S$_8$ bilayers, by which the Al layer is driven into the resistive state. The highly transparent S/N homointerface and the peculiar normal metal enable the flow of Josephson supercurrent across a 2.9 $\mu$m long weak link. Moreover, our JJ exhibits a giant critical current and a large product of the critical current and the normal state resistance.


title: A Novel Full-Polarization SAR Images Ship Detector Based on the Scattering Mechanisms and the Wave Polarization Anisotropy

abstract: Synthetic aperture radar (SAR) is considered being a good option for earth observation with its unique advantages. In this paper, we proposed an adaptive ship detector using full-polarization SAR images. First, by thoroughly investigating the scattering characteristics between ships and their background, and the wave polarization anisotropy, a novel ship detector is proposed by jointing the two characteristics, named Scattering-Anisotropy joint (joint-SA). Based on the theoretical analysis, we showed that the joint-SA is an effective physical quantity to show the difference between the ship and its background, and thus joint-SA can be used for ship detection of full-polarization image data. Second, the generalized Gamma distribution was used to characterize the joint-SA statistics of sea clutter with a large range of homogeneity. As a result, an adaptive constant false alarm rate (CFAR) method was implemented based on the joint-SA. Finally, RADARSAT-2 and GF-3 data in C-band and ALOS data in L-band are used for verification. We tested on five datasets, and the experimental results verify the correctness and superiority of the constant false alarm rate (CFAR) method based on the joint-SA. In addition, the experimental results also showed that the signal-clutter ratio (SCR) of the proposed ship detector joint-SA (33.17 dB, 35.98 dB, 57.25 dB) is better than that of DBSP (8.92 dB, 3.43 dB, 25.40 dB) and RsDVH (17.28 dB, 11.17 dB, 54.55 dB). More importantly, the proposed detector joint-SA has higher detection accuracy and a lower false alarm rate.


title: Mechanism of spin ordering in Fe$_{3}$O$_{4}$ nanoparticles by surface coating with organic acids

abstract: Saturation magnetization values close to the bulk have been reported for coated magnetite nanoparticles with organic acids. The mechanism of this effect is not yet understood. Here we show that a previously proposed rationalization in Nano Letters 12 (2021) 2499-2503 was based on electronic structure properties that are not consistent with several existing density functional theory studies. Our study is based on a wide set of Hubbard-corrected density functional tight binding (DTFB+U) and hybrid density functional theory (HSE06) calculations on Fe$_{3}$O$_{4}$ nanocubes of more than 400 atoms. We provide a new explanation for the spin ordering in coated nanoparticles, through the investigation of spin-flipping phenomena. In particular, we show that the spin-flip of d electrons at octahedral Fe$^{3+}$ sites, which is confirmed to be more favorable near the surface, especially where atomic reorganization can take place such as at corner sites, can be hampered by the presence of adsorbed organic acids because they do not only limit the surface reconstruction but also allow for additional ferromagnetic superexchange interaction between octahedral Fe sites as a consequence of the carboxylates bridging binding mode. The proof-of-concept of this mechanism is given by a simplified model of the Fe(III) tert-butoxide dimer.


title: ARAPUCA, light trapping device for the DUNE experiment

abstract: The Deep Underground Neutrino Experiment (DUNE) will be the first mega-science program on the US soil and will shade light on some of the open questions in neutrino physics. The experiment foresees the realization of an intense neutrino beam at Fermilab (Chicago - USA), of a near detector to monitor the beam and a far detector installed in the Sanford Underground Research Facility (SURF), 1300 km far away. Four 10 kt Liquid Argon Time Projection Chambers (LArTPC) will compose the 40 kt far detector modules to perform the precise measurements required for DUNE. The experimental technique uses charge and light signal from ionizing radiations in liquid argon to fully reconstruct neutrino interactions with excellent spatial resolution, calorimetric measurements and particle identification. The liquid argon scintillation light is produced around 127 nm within a few nanoseconds from the radiation passage. Its detection may improve the LArTPC calorimetric besides giving the time stamp of non-beam events, which is vital in fiducializing nucleon-decay events. The DUNE Photon Detection System (PDS) is responsible to efficiently collect this light in order to fiducialize the active volume of the detector with $>99\%$ efficiency. The PDS will be composed by 1,500 X-ARAPUCA modules, a light trapping device that was the main subject of this thesis. In this work, the research and development of the ARAPUCA devices will be presented. The full characterization of the prototypes were performed in dedicated liquid argon tests, in Brazil and Italy, where comparable efficiencies of (2.2 $\pm$ 0.4)% and (1.9 $\pm$ 0.1)% were found. A new wavelength shifter developed in Italy in collaboration with the Universita degli Studi di Milano-Bicocca will be presented. It allowed to increase the light detection efficiency of about 50% and resulted in an overall efficiency of (2.9 $\pm$ 0.1)% of the X-ARAPUCA.


title: Running coupling constant in thermal $\phi^4$ theory up to two loop order

abstract: Using the imaginary time formalism in thermal field theory, we derive running coupling constant and running mass in two loop order. In the process, we express the imaginary time formalism of Feynman diagrams as the summation of non-thermal quantum field theory (QFT) Feynman diagrams with coefficients that depend on temperature and mass. Renormalization constants for thermal $\phi^4$ theory were derived using simple diagrammatic analysis. Our model links the non-thermal QFT and the imaginary time formalism by assuming both have the same mass scale $\mu$ and coupling constant $g$. When these results are combined with the renormalization group equations (RGE) and applied simultaneously to thermal and non-thermal proper vertex functions, coupling constant and running mass with implicit temperature dependence are obtained. We evaluated pressure for scalar particles in two loop orders at zero external momentum limit by substituting the running mass result in the quasi-particle model.


title: Jigsaw: Large Language Models meet Program Synthesis

abstract: Large pre-trained language models such as GPT-3, Codex, and Google's language model are now capable of generating code from natural language specifications of programmer intent. We view these developments with a mixture of optimism and caution. On the optimistic side, such large language models have the potential to improve productivity by providing an automated AI pair programmer for every programmer in the world. On the cautionary side, since these large language models do not understand program semantics, they offer no guarantees about quality of the suggested code. In this paper, we present an approach to augment these large language models with post-processing steps based on program analysis and synthesis techniques, that understand the syntax and semantics of programs. Further, we show that such techniques can make use of user feedback and improve with usage. We present our experiences from building and evaluating such a tool jigsaw, targeted at synthesizing code for using Python Pandas API using multi-modal inputs. Our experience suggests that as these large language models evolve for synthesizing code from intent, jigsaw has an important role to play in improving the accuracy of the systems.


title: Fast and Accurate End-to-End Span-based Semantic Role Labeling as Word-based Graph Parsing

abstract: This paper proposes to cast end-to-end span-based SRL as a word-based graph parsing task. The major challenge is how to represent spans at the word level. Borrowing ideas from research on Chinese word segmentation and named entity recognition, we propose and compare four different schemata of graph representation, i.e., BES, BE, BIES, and BII, among which we find that the BES schema performs the best. We further gain interesting insights through detailed analysis. Moreover, we propose a simple constrained Viterbi procedure to ensure the legality of the output graph according to the constraints of the SRL structure. We conduct experiments on two widely used benchmark datasets, i.e., CoNLL05 and CoNLL12. Results show that our word-based graph parsing approach achieves consistently better performance than previous results, under all settings of end-to-end and predicate-given, without and with pre-trained language models (PLMs). More importantly, our model can parse 669/252 sentences per second, without and with PLMs respectively.


title: Solution of lepton $g-2$ anomalies with nonlocal QED

abstract: The explanation for lepton $g-2$ anomalies is provided with the nonlocal QED which is the simple extension of the standard model. This solution is based on the same gauge symmetry as QED without introducing any new particles and interactions. The correlation functions in the nonlocal strength tension and lepton-photon interaction make it possible to explain the discrepancies of both $\Delta a_\mu$ and $\Delta a_e$. With the same approach, the discrepancy of anomalous magnetic moment of $\tau$ lepton from standard model is estimated in the range $1.19\times10^{-5}$ to $3.21\times10^{-3}$ which is covered by the current experimental uncertainty.


title: Hardware Trojan Insertion in Finalized Layouts: From Methodology to a Silicon Demonstration

abstract: Owning a high-end semiconductor foundry is a luxury very few companies can afford. Thus, fabless design companies outsource integrated circuit fabrication to third parties. Within foundries, rogue elements may gain access to the customer's layout and perform malicious acts, including the insertion of a hardware trojan (HT). Many works focus on the structure/effects of a HT, while very few have demonstrated the viability of their HTs in silicon. Even fewer disclose how HTs are inserted or the time required for this activity. Our work details, for the first time, how effortlessly a HT can be inserted into a finalized layout by presenting an insertion framework based on the engineering change order flow. For validation, we have built an ASIC prototype in 65nm CMOS technology comprising of four trojaned cryptocores. A side-channel HT is inserted in each core with the intent of leaking the cryptokey over a power channel. Moreover, we have determined that the entire attack can be mounted in a little over one hour. We also show that the attack was successful for all tested samples. Finally, our measurements demonstrate the robustness of our SCT against skews in the manufacturing process.


title: Eccentric debris disc morphologies I: exploring the origin of apocentre and pericentre glows in face-on debris discs

abstract: The location of surface brightness maxima (e.g. apocentre and pericentre glow) in eccentric debris discs are often used to infer the underlying orbits of the dust and planetesimals that comprise the disc. However, there is a misconception that eccentric discs have higher surface densities at apocentre and thus necessarily exhibit apocentre glow at long wavelengths. This arises from the expectation that the slower velocities at apocentre lead to a "pile up'" of dust, which fails to account for the greater area over which dust is spread at apocentre. Instead we show with theory and by modelling three different regimes that the morphology and surface brightness distributions of face-on debris discs are strongly dependent on their eccentricity profile (i.e. whether this is constant, rising or falling with distance). We demonstrate that at shorter wavelengths the classical pericentre glow effect remains true, whereas at longer wavelengths discs can either demonstrate apocentre glow or pericentre glow. We additionally show that at long wavelengths the same disc morphology can produce either apocentre glow or pericentre glow depending on the observational resolution. Finally, we show that the classical approach of interpreting eccentric debris discs using line densities is only valid under an extremely limited set of circumstances, which are unlikely to be met as debris disc observations become increasingly better resolved.


title: Randomness in the choice of neighbours promotes cohesion in mobile animal groups

abstract: Classic computational models of collective motion suggest that simple local averaging rules can promote many observed group level patterns. Recent studies, however, suggest that rules simpler than local averaging may be at play in real organisms; for example, fish stochastically align towards only one randomly chosen neighbour and yet the schools are highly polarised. Here, we ask -- how do organisms maintain group cohesion? Using a spatially-explicit model, inspired from empirical investigations, we show that group cohesion can be achieved even when organisms randomly choose only one neighbour to interact with. Cohesion is maintained even in the absence of local averaging that requires interactions with many neighbours. Furthermore, we show that choosing a neighbour randomly is a better way to achieve cohesion than interacting with just its closest neighbour. To understand how cohesion emerges from these random pairwise interactions, we turn to a graph-theoretic analysis of the underlying dynamic interaction networks. We find that randomness in choosing a neighbour gives rise to well-connected networks that essentially cause the groups to stay cohesive. We compare our findings with the canonical averaging models (analogous to the Vicsek model). In summary, we argue that randomness in the choice of interacting neighbours plays a crucial role in collective motion.


title: Quantum phases of ferromagnetically coupled dimers on Shastry-Sutherland lattice

abstract: The ground state (gs) of antiferromagnetically coupled dimers on the Shastry-Sutherland lattice (SSL) stabilizes many exotic phases and has been extensively studied. The gs properties of ferromagnetically coupled dimers on SSL are equally important but unexplored. In this model the exchange coupling along the $x$-axis ($J_x$) and $y$-axis ($J_y$) are ferromagnetic and the diagonal exchange coupling ($J$) is antiferromagnetic. In this work we explore the quantum phase diagram of ferromagnetically coupled dimer model numerically using density matrix renormalization group (DMRG) method. We note that in $J_x$-$J_y$ parameter space this model exhibits six interesting phases:(I) stripe $(0,\pi)$, (II) stripe $(\pi,0)$, (III) perfect dimer, (IV) $X$-spiral, (V) $Y$-spiral and (VI) ferromagnetic phase. Phase boundaries of these quantum phases are determined using the correlation functions and gs energies. We also notice the correlation length in this system is less than four lattice units in most of the parameter regimes. The non-collinear behaviour in $X$-spiral and $Y$-spiral phase and the dependence of pitch angles on model parameters are also studied.


title: Lecture Notes on Partially Known MDPs

abstract: In these notes we will tackle the problem of finding optimal policies for Markov decision processes (MDPs) which are not fully known to us. Our intention is to slowly transition from an offline setting to an online (learning) setting. Namely, we are moving towards reinforcement learning.


title: Near-Infrared Polarization from Unresolved Disks Around Brown Dwarfs and Young Stellar Objects

abstract: Wide-field near-infrared (NIR) polarimetry was used to examine disk systems around two brown dwarfs (BD) and two young stellar objects (YSO) embedded in the Heiles Cloud 2 (HCl2) dark molecular cloud in Taurus as well as numerous stars located behind HCl2. Inclined disks exhibit intrinsic NIR polarization due to scattering of photospheric light which is detectable even for unresolved systems. After removing polarization contributions from magnetically aligned dust in HCl2 determined from the background star information, significant intrinsic polarization was detected from the disk systems of of one BD (ITG~17) and both YSOs (ITG~15, ITG~25), but not from the other BD (2M0444). The ITG~17 BD shows good agreement of the disk orientation inferred from the NIR and from published ALMA dust continuum imaging. ITG~17 was also found to reside in a 5,200~au wide binary (or hierarchical quad star system) with the ITG~15 YSO disk system. The inferred disk orientations from the NIR for ITG~15 and ITG~17 are parallel to each other and perpendicular to the local magnetic field direction. The multiplicity of the system and the large BD disk nature could have resulted from formation in an environment characterized by misalignment of the magnetic field and the protostellar disks.


title: Long-term FRII jet evolution in dense environments

abstract: We present long-term numerical three-dimensional simulations of a relativistic outflow propagating through a galactic ambient medium and environment, up to distances $\sim 100$~kpc. Our aim is to study the role of dense media in the global dynamics of the radio source. We use a relativistic gas equation of state, and a basic description of thermal cooling terms. In previous work, we showed that a linear perturbation could enhance the jet propagation during the early phases of evolution, by introducing obliquity to the jet reverse shock. Here, we show that this effect is reduced in denser media. We find that the dentist-drill effect acts earlier, due to slower jet propagation and an increased growth of the helical instability. The global morphology of the jet is less elongated, with more prominent lobes. The fundamental physical parameters of the jet generated structure derived from our simulations fall within the estimated values derived for FRII jets in the 3C sample. In agreement with previous axisymmetric and three dimensional simulations in lower density media, we conclude that shock heating of the interstellar and intergalactic media is very efficient in the case of powerful, relativistic jets.


title: Flexible-Joint Manipulator Trajectory Tracking with Learned Two-Stage Model employing One-Step Future Prediction

abstract: Flexible-joint manipulators are frequently used for increased safety during human-robot collaboration and shared workspace tasks. However, joint flexibility significantly reduces the accuracy of motion, especially at high velocities and with inexpensive actuators. In this paper, we present a learning-based approach to identify the unknown dynamics of a flexible-joint manipulator and improve the trajectory tracking at high velocities. We propose a two-stage model which is composed of a one-step forward dynamics future predictor and an inverse dynamics estimator. The second part is based on linear time-invariant dynamical operators to approximate the feed-forward joint position and velocity commands. We train the model end-to-end on real-world data and evaluate it on the Baxter robot. Our experiments indicate that augmenting the input with one-step future state prediction improves the performance, compared to the same model without prediction. We compare joint position, joint velocity and end-effector position tracking accuracy against the classical baseline controller and several simpler models.


title: Energy transfer mechanisms in adverse pressure gradient turbulent boundary layers

abstract: The energy transfer mechanisms and structures playing a role in these mechanisms in adverse-pressure-gradient (APG) turbulent boundary layers (TBLs) with small and large velocity defects are investigated. We examine the wall-normal and spectral distributions of energy, production and pressure-strain in APG TBLs and compare these distributions with those in canonical flows. It is found that the spectral distributions of production and pressure-strain are not profoundly affected by an increase of the velocity defect, although the energy spectra drastically change in the inner layer of the large defect APG TBL. In the latter, the signature of the inner layer streaks is absent from the energy spectra. However, the production and pressure-strain spectra suggest that the near-wall cycle or another energy transfer mechanism with similar spectral features still exist in large defect TBLs. In the outer layer, energetic, production and pressure-strain structures appear to change from wall-attached to wall-detached structures with increasing velocity defect. Despite this, the 2D spectral distributions have similar shapes and wavelength aspect ratios of the peaks in all these flows. These observations suggest that outer layer energy transfer mechanisms may be the same in wall-bounded flows, no matter if dynamically relevant structures are attached or detached to the wall. Therefore, the conclusion is that the mechanisms responsible for turbulence production and inter-component energy transfer may remain the same within each layer in all these flows. It is the intensity of these mechanisms within one layer that changes with velocity defect, because of the local mean shear variation.


title: Role of Spin-Orbit Coupling in High-order Harmonic Generation Revealed by Super-Cycle Rydberg Trajectories

abstract: High-harmonic generation is typically thought of as a sub-laser-cycle process, with the electron's excursion in the continuum lasting a fraction of the optical cycle. However, it was recently suggested that long-lived Rydberg states can play a particularly important role in atoms driven by the combination of the counter-rotating circularly polarized fundamental light field and its second harmonic. Here we report direct experimental evidence of long and stable Rydberg trajectories contributing to high-harmonic generation. We confirm their effect on the harmonic emission via Time-Dependent Schr{\"o}dinger Equation simulations and track their dynamics inside the laser pulse using the spin-orbit evolution in the ionic core, utilizing the spin-orbit Larmor clock. Our observations contrast sharply with the general view that long-lived Rydberg orbits should generate negligible contribution to the macroscopic far-field high harmonic response of the medium. Indeed, we show how and why radiation from such states can lead to well collimated macroscopic signal in the far field.


title: Topology in high-$T$ QCD via staggered spectral projectors

abstract: We present preliminary lattice results for the topological susceptibility in high-$T$ $N_f=2+1$ QCD obtained discretizing this observable via spectral projectors on eigenmodes of the staggered operator, and we compare them with those obtained with the standard gluonic definition. The adoption of the spectral discretization is motivated by the large lattice artifacts affecting the continuum scaling of the gluonic susceptibility at high $T$, related to the choice of non-chiral fermions in the action.


title: Shallow Trimers of Two Identical Fermions and One Particle in Resonant Regimes

abstract: We consider two identical fermions interacting in the p-wave channel. Each fermion also interacts with another particle in the vicinity of an s-wave resonance. We find that in addition to the Kartavtsev-Malykh universal trimer states resulting from the s-wave particle-fermion interaction, the fermion-fermion p-wave interaction induces one or two shallow trimers in a large domain of the control parameters, including a borromean regime where the ground-state trimer exists in the absence of dimers at any mass ratio between the fermions and the particle. A generic picture of the trimer spectrum emerges from this work in terms of the low-energy parameters of the interactions.


title: Acceleration of Metal Nanoparticle with Irradiation Pressure

abstract: The acceleration of an spheroidal metal nanoparticle in an irradiation field with a frequency close to the surface plasmon vibration has been considered. Under the action of radiation pressure, the polarizability for nonspherical particle becomes a tensor quantity. The analytical expressions for the resonance acceleration components for the cases of plane-polarized and circularly polarized light have been derived. We have demonstrated that the resonance acceleration can depend substantially on the shape of a metal nanoparticle and its orientation with respect to the directions of light propagation and the light polarization.


title: The Linear-Time-Invariance Notion of the Koopman Analysis-Part 1: The Architecture, Practical Rendering on the Prism Wake, and Fluid-Structure Association

abstract: This work proposes a Linear-Time-Invariance (LTI) notion to the Koopman analysis, finding an invariant subspace on which Koopman modes are consistent and physically meaningful. It also develops the Koopman-LTI architecture -- a systematic procedure to associate fluid excitation and structure surface pressure by matching Koopman eigen tuples, solving a longstanding problem for fluid-structure interactions. The architecture is data-driven and modular, accommodating all types of data and Koopman algorithms. Through a pedagogical demonstration on a prism wake and the rudimentary Dynamic Mode Decomposition algorithm, results show a near-exact linearization of nonlinear turbulence, with mean and rms errors of O-12 and O-9, respectively. The DMD also approximated the Koopman modes with O-8 error. The LTI reduced the subcritical prism wake during shear layer transition II into only six dominant excitation-response Koopman modal duplets. The upstream and crosswind walls constitute a dynamically unified interface dominated by only two mechanisms. The downstream wall remains a distinct interface and is dominated by four other mechanisms. The complete revelation of the prism wake essentially comes down to understanding the six mechanisms, which Part 2 (Li et al., 2022) will address by investigating the physical interpretations of the duplets' in-synch, phenomenological features. Finally, the current analysis also revealed w's trivial role in this convection-dominated free-shear flow, Reynolds stresses' spectral description of cascading eddies, vortices' sensitivity to dilation and indifference to distortion, and structure responses' origin in vortex activities.


title: A low Mach two-speed relaxation scheme for the compressible Euler equations with gravity

abstract: We present a numerical approximation of the solutions of the Euler equations with a gravitational source term. On the basis of a Suliciu type relaxation model with two relaxation speeds, we construct an approximate Riemann solver, which is used in a first order Godunov-type finite volume scheme. This scheme can preserve both stationary solutions and the low Mach limit to the corresponding incompressible equations. In addition, we prove that our scheme preserves the positivity of density and internal energy, that it is entropy satisfying and also guarantees not to give rise to numerical checkerboard modes in the incompressible limit. Later we give an extension to second order that preserves positivity, asymptotic-preserving and well-balancing properties. Finally, the theoretical properties are investigated in numerical experiments.


title: Low c-differential uniformity for functions modified on subfields

abstract: In this paper, we construct some piecewise defined functions, and study their $c$-differential uniformity. As a by-product, we improve upon several prior results. Further, we look at concatenations of functions with low differential uniformity and show several results. For example, we prove that given $\beta_i$ (a basis of $\mathbb{F}_{q^n}$ over $\mathbb{F}_q$), some functions $f_i$ of $c$-differential uniformities $\delta_i$, and $L_i$ (specific linearized polynomials defined in terms of $\beta_i$), $1\leq i\leq n$, then $F(x)=\sum_{i=1}^n\beta_i f_i(L_i(x))$ has $c$-differential uniformity equal to $\prod_{i=1}^n \delta_i$.


title: Properties of Overlap and Domain Wall Fermions in the 2+1D Thirring Model

abstract: We present some results pertaining to partially quenched formulations of the overlap/domain wall operator with the Thirring model in 2+1D. Auxiliary fields are generated with a Shamir domain wall approach and measurements of eigenvalues and condensates are contrasted with different overlap operators. The numerical challenge posed by a non-compact formulation is highlighted, and the effective use of lower accuracy sea fermions is demonstrated.


title: On the complexity of Dark Chinese Chess

abstract: This paper provides a complexity analysis for the game of dark Chinese chess (a.k.a. "JieQi"), a variation of Chinese chess. Dark Chinese chess combines some of the most complicated aspects of board and card games, such as long-term strategy or planning, large state space, stochastic, and imperfect-information, which make it closer to the real world decision-making problem and pose great challenges to game AI. Here we design a self-play program to calculate the game tree complexity and average information set size of the game, and propose an algorithm to calculate the number of information sets.


title: 4DContrast: Contrastive Learning with Dynamic Correspondences for 3D Scene Understanding

abstract: We present a new approach to instill 4D dynamic object priors into learned 3D representations by unsupervised pre-training. We observe that dynamic movement of an object through an environment provides important cues about its objectness, and thus propose to imbue learned 3D representations with such dynamic understanding, that can then be effectively transferred to improved performance in downstream 3D semantic scene understanding tasks. We propose a new data augmentation scheme leveraging synthetic 3D shapes moving in static 3D environments, and employ contrastive learning under 3D-4D constraints that encode 4D invariances into the learned 3D representations. Experiments demonstrate that our unsupervised representation learning results in improvement in downstream 3D semantic segmentation, object detection, and instance segmentation tasks, and moreover, notably improves performance in data-scarce scenarios.


title: Cross-Modality Attentive Feature Fusion for Object Detection in Multispectral Remote Sensing Imagery

abstract: Cross-modality fusing complementary information of multispectral remote sensing image pairs can improve the perception ability of detection algorithms, making them more robust and reliable for a wider range of applications, such as nighttime detection. Compared with prior methods, we think different features should be processed specifically, the modality-specific features should be retained and enhanced, while the modality-shared features should be cherry-picked from the RGB and thermal IR modalities. Following this idea, a novel and lightweight multispectral feature fusion approach with joint common-modality and differential-modality attentions are proposed, named Cross-Modality Attentive Feature Fusion (CMAFF). Given the intermediate feature maps of RGB and IR images, our module parallel infers attention maps from two separate modalities, common- and differential-modality, then the attention maps are multiplied to the input feature map respectively for adaptive feature enhancement or selection. Extensive experiments demonstrate that our proposed approach can achieve the state-of-the-art performance at a low computation cost.


title: Towards More Robust Natural Language Understanding

abstract: Natural Language Understanding (NLU) is a branch of Natural Language Processing (NLP) that uses intelligent computer software to understand texts that encode human knowledge. Recent years have witnessed notable progress across various NLU tasks with deep learning techniques, especially with pretrained language models. Besides proposing more advanced model architectures, constructing more reliable and trustworthy datasets also plays a huge role in improving NLU systems, without which it would be impossible to train a decent NLU model. It's worth noting that the human ability of understanding natural language is flexible and robust. On the contrary, most of existing NLU systems fail to achieve desirable performance on out-of-domain data or struggle on handling challenging items (e.g., inherently ambiguous items, adversarial items) in the real world. Therefore, in order to have NLU models understand human language more effectively, it is expected to prioritize the study on robust natural language understanding. In this thesis, we deem that NLU systems are consisting of two components: NLU models and NLU datasets. As such, we argue that, to achieve robust NLU, the model architecture/training and the dataset are equally important. Specifically, we will focus on three NLU tasks to illustrate the robustness problem in different NLU tasks and our contributions (i.e., novel models and new datasets) to help achieve more robust natural language understanding. Moving forward, the ultimate goal for robust natural language understanding is to build NLU models which can behave humanly. That is, it's expected that robust NLU systems are capable to transfer the knowledge from training corpus to unseen documents more reliably and survive when encountering challenging items even if the system doesn't know a priori of users' inputs.


title: Neutrino Mass Bounds in the era of Tension Cosmology

abstract: The measurements of Cosmic Microwave Background anisotropies made by the Planck satellite provide extremely tight upper bounds on the total neutrino mass scale ($\Sigma m_{\nu}<0.26 eV$ at $95\%$ C.L.). However, as recently discussed in the literature, Planck data show anomalies that could affect this result. Here we provide new constraints on neutrino masses using the recent and complementary CMB measurements from the Atacama Cosmology Telescope DR4 and the South Polar Telescope SPT-3G experiments. We found that both the ACT-DR4 and SPT-3G data, when combined with WMAP, mildly suggest a neutrino mass with $\Sigma m_{\nu}=0.68 \pm 0.31$ eV and $\Sigma m_{\nu}=0.46_{-0.36}^{+0.14}$ eV at $68 \%$ C.L, respectively. Moreover, when CMB lensing from the Planck experiment is included, the ACT-DR4 data now indicates a neutrino mass above the two standard deviations, with $\Sigma m_{\nu}=0.60_{-0.50}^{+0.44}$ eV at $95 \%$, while WMAP+SPT-3G provides a weak upper limit of $\Sigma m_{\nu}<0.37$ eV at $68 \%$ C.L.. Interestingly, these results are consistent with the Planck CMB+Lensing constraint of $\Sigma m_{\nu} = 0.41_{-0.25}^{+0.17}$ eV at $68 \%$ C.L. when variation in the $A_{\rm lens}$ parameter are considered. We also show that these indications are still present after the inclusion of BAO or SN-Ia data in extended cosmologies that are usually considered to solve the so-called Hubble tension. A combination of ACT-DR4, WMAP, BAO and constraints on the Hubble constant from the SH0ES collaboration gives $\Sigma m_{\nu}=0.39^{+0.13}_{-0.25}$ eV at $68 \%$ C.L. in extended cosmologies. We conclude that a total neutrino mass above the $0.26$ eV limit still provides an excellent fit to several cosmological data and that future data must be considered before safely ruling it out.


title: IBERT: Idiom Cloze-style reading comprehension with Attention

abstract: Idioms are special fixed phrases usually derived from stories. They are commonly used in casual conversations and literary writings. Their meanings are usually highly non-compositional. The idiom cloze task is a challenge problem in Natural Language Processing (NLP) research problem. Previous approaches to this task are built on sequence-to-sequence (Seq2Seq) models and achieved reasonably well performance on existing datasets. However, they fall short in understanding the highly non-compositional meaning of idiomatic expressions. They also do not consider both the local and global context at the same time. In this paper, we proposed a BERT-based embedding Seq2Seq model that encodes idiomatic expressions and considers them in both global and local context. Our model uses XLNET as the encoder and RoBERTa for choosing the most probable idiom for a given context. Experiments on the EPIE Static Corpus dataset show that our model performs better than existing state-of-the-arts.


title: TaskDrop: A Competitive Baseline for Continual Learning of Sentiment Classification

abstract: In this paper, we study the multi-task sentiment classification problem in the continual learning setting, i.e., a model is sequentially trained to classifier the sentiment of reviews of products in a particular category. The use of common sentiment words in reviews of different product categories leads to large cross-task similarity, which differentiates it from continual learning in other domains. This knowledge sharing nature renders forgetting reduction focused approaches less effective for the problem under consideration. Unlike existing approaches, where task-specific masks are learned with specifically presumed training objectives, we propose an approach called Task-aware Dropout (TaskDrop) to generate masks in a random way. While the standard dropout generates and applies random masks for each training instance per epoch for effective regularization, TaskDrop applies random masking for task-wise capacity allocation and reuse. We conducted experimental studies on three multi-task review datasets and made comparison to various baselines and state-of-the-art approaches. Our empirical results show that regardless of simplicity, TaskDrop overall achieved competitive performances for all the three datasets, especially after relative long term learning. This demonstrates that the proposed random capacity allocation mechanism works well for continual sentiment classification.


title: Modular Pipe Climber III with Three-Output Open Differential

abstract: The paper introduces the novel Modular Pipe Climber III with a Three-Output Open Differential (3-OOD) mechanism to eliminate slipping of the tracks due to the changing cross-sections of the pipe. This will be achieved in any orientation of the robot. Previous pipe climbers use three-wheel/track modules, each with an individual driving mechanism to achieve stable traversing. Slipping of tracks is prevalent in such robots when it encounters the pipe turns. Thus, active control of each module's speed is employed to mitigate the slip, thereby requiring substantial control effort. The proposed pipe climber implements the 3-OOD to address this issue by allowing the robot to mechanically modulate the track speeds as it encounters a turn. The proposed 3-OOD is the first three-output differential to realize the functional abilities of a traditional two-output differential.


title: Language Semantics Interpretation with an Interaction-based Recurrent Neural Networks

abstract: Text classification is a fundamental language task in Natural Language Processing. A variety of sequential models is capable making good predictions yet there is lack of connection between language semantics and prediction results. This paper proposes a novel influence score (I-score), a greedy search algorithm called Backward Dropping Algorithm (BDA), and a novel feature engineering technique called the "dagger technique". First, the paper proposes a novel influence score (I-score) to detect and search for the important language semantics in text document that are useful for making good prediction in text classification tasks. Next, a greedy search algorithm called the Backward Dropping Algorithm is proposed to handle long-term dependencies in the dataset. Moreover, the paper proposes a novel engineering technique called the "dagger technique" that fully preserve the relationship between explanatory variable and response variable. The proposed techniques can be further generalized into any feed-forward Artificial Neural Networks (ANNs) and Convolutional Neural Networks (CNNs), and any neural network. A real-world application on the Internet Movie Database (IMDB) is used and the proposed methods are applied to improve prediction performance with an 81% error reduction comparing with other popular peers if I-score and "dagger technique" are not implemented.


title: A PubMedBERT-based Classifier with Data Augmentation Strategy for Detecting Medication Mentions in Tweets

abstract: As a major social media platform, Twitter publishes a large number of user-generated text (tweets) on a daily basis. Mining such data can be used to address important social, public health, and emergency management issues that are infeasible through other means. An essential step in many text mining pipelines is named entity recognition (NER), which presents some special challenges for tweet data. Among them are nonstandard expressions, extreme imbalanced classes, and lack of context information, etc. The track 3 of BioCreative challenge VII (BC7) was organized to evaluate methods for detecting medication mentions in tweets. In this paper, we report our work on BC7 track 3, where we explored a PubMedBERT-based classifier trained with a combination of multiple data augmentation approaches. Our method achieved an F1 score of 0.762, which is substantially higher than the mean of all submissions (0.696).


title: Dynamic Mirror Descent based Model Predictive Control for Accelerating Robot Learning

abstract: Recent works in Reinforcement Learning (RL) combine model-free (Mf)-RL algorithms with model-based (Mb)-RL approaches to get the best from both: asymptotic performance of Mf-RL and high sample-efficiency of Mb-RL. Inspired by these works, we propose a hierarchical framework that integrates online learning for the Mb-trajectory optimization with off-policy methods for the Mf-RL. In particular, two loops are proposed, where the Dynamic Mirror Descent based Model Predictive Control (DMD-MPC) is used as the inner loop Mb-RL to obtain an optimal sequence of actions. These actions are in turn used to significantly accelerate the outer loop Mf-RL. We show that our formulation is generic for a broad class of MPC-based policies and objectives, and includes some of the well-known Mb-Mf approaches. We finally introduce a new algorithm: Mirror-Descent Model Predictive RL (M-DeMoRL), which uses Cross-Entropy Method (CEM) with elite fractions for the inner loop. Our experiments show faster convergence of the proposed hierarchical approach on benchmark MuJoCo tasks. We also demonstrate hardware training for trajectory tracking in a 2R leg and hardware transfer for robust walking in a quadruped. We show that the inner-loop Mb-RL significantly decreases the number of training iterations required in the real system, thereby validating the proposed approach.


title: Sequential Randomized Smoothing for Adversarially Robust Speech Recognition

abstract: While Automatic Speech Recognition has been shown to be vulnerable to adversarial attacks, defenses against these attacks are still lagging. Existing, naive defenses can be partially broken with an adaptive attack. In classification tasks, the Randomized Smoothing paradigm has been shown to be effective at defending models. However, it is difficult to apply this paradigm to ASR tasks, due to their complexity and the sequential nature of their outputs. Our paper overcomes some of these challenges by leveraging speech-specific tools like enhancement and ROVER voting to design an ASR model that is robust to perturbations. We apply adaptive versions of state-of-the-art attacks, such as the Imperceptible ASR attack, to our model, and show that our strongest defense is robust to all attacks that use inaudible noise, and can only be broken with very high distortion.


title: Development of a robust cascaded architecture for intelligent robot grasping using limited labelled data

abstract: Grasping objects intelligently is a challenging task even for humans and we spend a considerable amount of time during our childhood to learn how to grasp objects correctly. In the case of robots, we can not afford to spend that much time on making it to learn how to grasp objects effectively. Therefore, in the present research we propose an efficient learning architecture based on VQVAE so that robots can be taught with sufficient data corresponding to correct grasping. However, getting sufficient labelled data is extremely difficult in the robot grasping domain. To help solve this problem, a semi-supervised learning based model which has much more generalization capability even with limited labelled data set, has been investigated. Its performance shows 6\% improvement when compared with existing state-of-the-art models including our earlier model. During experimentation, It has been observed that our proposed model, RGGCNN2, performs significantly better, both in grasping isolated objects as well as objects in a cluttered environment, compared to the existing approaches which do not use unlabelled data for generating grasping rectangles. To the best of our knowledge, developing an intelligent robot grasping model (based on semi-supervised learning) trained through representation learning and exploiting the high-quality learning ability of GGCNN2 architecture with the limited number of labelled dataset together with the learned latent embeddings, can be used as a de-facto training method which has been established and also validated in this paper through rigorous hardware experimentations using Baxter (Anukul) research robot.


title: GraphPrompt: Graph-Based Prompt Templates for Biomedical Synonym Prediction

abstract: In the expansion of biomedical dataset, the same category may be labeled with different terms, thus being tedious and onerous to curate these terms. Therefore, automatically mapping synonymous terms onto the ontologies is desirable, which we name as biomedical synonym prediction task. Unlike biomedical concept normalization (BCN), no clues from context can be used to enhance synonym prediction, making it essential to extract graph features from ontology. We introduce an expert-curated dataset OBO-syn encompassing 70 different types of concepts and 2 million curated concept-term pairs for evaluating synonym prediction methods. We find BCN methods perform weakly on this task for not making full use of graph information. Therefore, we propose GraphPrompt, a prompt-based learning approach that creates prompt templates according to the graphs. GraphPrompt obtained 37.2\% and 28.5\% improvement on zero-shot and few-shot settings respectively, indicating the effectiveness of these graph-based prompt templates. We envision that our method GraphPrompt and OBO-syn dataset can be broadly applied to graph-based NLP tasks, and serve as the basis for analyzing diverse and accumulating biomedical data. All the data and codes are avalible at: https://github.com/HanwenXuTHU/GraphPrompt


title: What goes on inside rumour and non-rumour tweets and their reactions: A Psycholinguistic Analyses

abstract: In recent years, the problem of rumours on online social media (OSM) has attracted lots of attention. Researchers have started investigating from two main directions. First is the descriptive analysis of rumours and secondly, proposing techniques to detect (or classify) rumours. In the descriptive line of works, where researchers have tried to analyse rumours using NLP approaches, there isnt much emphasis on psycho-linguistics analyses of social media text. These kinds of analyses on rumour case studies are vital for drawing meaningful conclusions to mitigate misinformation. For our analysis, we explored the PHEME9 rumour dataset (consisting of 9 events), including source tweets (both rumour and non-rumour categories) and response tweets. We compared the rumour and nonrumour source tweets and then their corresponding reply (response) tweets to understand how they differ linguistically for every incident. Furthermore, we also evaluated if these features can be used for classifying rumour vs. non-rumour tweets through machine learning models. To this end, we employed various classical and ensemble-based approaches. To filter out the highly discriminative psycholinguistic features, we explored the SHAP AI Explainability tool. To summarise, this research contributes by performing an in-depth psycholinguistic analysis of rumours related to various kinds of events.


title: CU-UD: text-mining drug and chemical-protein interactions with ensembles of BERT-based models

abstract: Identifying the relations between chemicals and proteins is an important text mining task. BioCreative VII track 1 DrugProt task aims to promote the development and evaluation of systems that can automatically detect relations between chemical compounds/drugs and genes/proteins in PubMed abstracts. In this paper, we describe our submission, which is an ensemble system, including multiple BERT-based language models. We combine the outputs of individual models using majority voting and multilayer perceptron. Our system obtained 0.7708 in precision and 0.7770 in recall, for an F1 score of 0.7739, demonstrating the effectiveness of using ensembles of BERT-based language models for automatically detecting relations between chemicals and proteins. Our code is available at https://github.com/bionlplab/drugprot_bcvii.


title: Multi-Class and Automated Tweet Categorization

abstract: Twitter is among the most prevalent social media platform being used by millions of people all over the world. It is used to express ideas and opinions about political, social, business, sports, health, religion, and various other categories. The study reported here aims to detect the tweet category from its text. It becomes quite challenging when text consists of 140 characters only, with full of noise. The tweet is categorized under 12 specified categories using Text Mining or Natural Language Processing (NLP), and Machine Learning (ML) techniques. It is observed that a huge number of trending topics are provided by Twitter but it is really challenging to find out that what these trending topics are all about. Therefore, it is extremely crucial to automatically categorize the tweets into general categories for plenty of information extraction tasks. A large dataset is constructed by combining two different nature of datasets having varying levels of category identification complexities. It is annotated by experts under proper guidelines for increased quality and high agreement values. It makes the proposed model quite robust. Various types of ML algorithms were used to train and evaluate the proposed model. These models have explored over three datasets separately. It is explored that the nature of the dataset is highly non-linear therefore complex or non-linear models perform better. The best ensemble model named, Gradient Boosting achieved an AUC score of 85\%. That is much better than the other related studies conducted.


title: Takagi-Sugeno Fuzzy Modeling and Control for Effective Robotic Manipulator Motion

abstract: Robotic manipulators are widely used in applications that require fast and precise motion. Such devices, however, are prompt to nonlinear control issues due to the flexibility in joints and the friction in the motors within the dynamics of their rigid part. To address these issues, the Linear Matrix Inequalities (LMIs) and Parallel Distributed Compensation (PDC) approaches are implemented in the Takagy-Sugeno Fuzzy Model (T-SFM). We propose the following methodology; initially, the state space equations of the nonlinear manipulator model are derived. Next, a Takagy-Sugeno Fuzzy Model (T-SFM) technique is used for linearizing the state space equations of the nonlinear manipulator. The T-SFM controller is developed using the Parallel Distributed Compensation (PDC) method. The prime concept of the designed controller is to compensate for all the fuzzy rules. Furthermore, the Linear Matrix Inequalities (LMIs) are applied to generate adequate cases to ensure stability and control. Convex programming methods are applied to solve the developed LMIs problems. Simulations developed for the proposed model show that the proposed controller stabilized the system with zero tracking error in less than 1.5 s.


title: How to Build Robust FAQ Chatbot with Controllable Question Generator?

abstract: Many unanswerable adversarial questions fool the question-answer (QA) system with some plausible answers. Building a robust, frequently asked questions (FAQ) chatbot needs a large amount of diverse adversarial examples. Recent question generation methods are ineffective at generating many high-quality and diverse adversarial question-answer pairs from unstructured text. We propose the diversity controllable semantically valid adversarial attacker (DCSA), a high-quality, diverse, controllable method to generate standard and adversarial samples with a semantic graph. The fluent and semantically generated QA pairs fool our passage retrieval model successfully. After that, we conduct a study on the robustness and generalization of the QA model with generated QA pairs among different domains. We find that the generated data set improves the generalizability of the QA model to the new target domain and the robustness of the QA model to detect unanswerable adversarial questions.


title: How News Evolves? Modeling News Text and Coverage using Graphs and Hawkes Process

abstract: Monitoring news content automatically is an important problem. The news content, unlike traditional text, has a temporal component. However, few works have explored the combination of natural language processing and dynamic system models. One reason is that it is challenging to mathematically model the nuances of natural language. In this paper, we discuss how we built a novel dataset of news articles collected over time. Then, we present a method of converting news text collected over time to a sequence of directed multi-graphs, which represent semantic triples (Subject -> Predicate} ->Object). We model the dynamics of specific topological changes in these graphs using a set of multivariate count series, which we fit the discrete-time Hawkes process. With our real-world data, we show that the multivariate time series contain both dynamic information of how many articles/words were published each day and semantic information of the content of the articles. This yields novel insights into how news events are covered. We show with the experiment that our approach can be used to infer from a sequence of news articles if the articles were published by major or entertainment news outlets.


title: Weakly Supervised Prototype Topic Model with Discriminative Seed Words: Modifying the Category Prior by Self-exploring Supervised Signals

abstract: Dataless text classification, i.e., a new paradigm of weakly supervised learning, refers to the task of learning with unlabeled documents and a few predefined representative words of categories, known as seed words. The recent generative dataless methods construct document-specific category priors by using seed word occurrences only, however, such category priors often contain very limited and even noisy supervised signals. To remedy this problem, in this paper we propose a novel formulation of category prior. First, for each document, we consider its label membership degree by not only counting seed word occurrences, but also using a novel prototype scheme, which captures pseudo-nearest neighboring categories. Second, for each label, we consider its frequency prior knowledge of the corpus, which is also a discriminative knowledge for classification. By incorporating the proposed category prior into the previous generative dataless method, we suggest a novel generative dataless method, namely Weakly Supervised Prototype Topic Model (WSPTM). The experimental results on real-world datasets demonstrate that WSPTM outperforms the existing baseline methods.


title: Optimized Deployment of Unmanned Aerial Vehicles for Wildfire Detection and Monitoring

abstract: In recent years, increased wildfires have caused irreversible damage to forest resources worldwide, threatening wildlives and human living conditions. The lack of accurate frontline information in real-time can pose great risks to firefighters. Though a plethora of machine learning algorithms have been developed to detect wildfires using aerial images and videos captured by drones, there is a lack of methods corresponding to drone deployment. We propose a wildfire rapid response system that optimizes the number and relative positions of drones to achieve full coverage of the whole wildfire area. Trained on the data from historical wildfire events, our model evaluates the possibility of wildfires at different scales and accordingly allocates the resources. It adopts plane geometry to deploy drones while balancing the capability and safety with inequality constrained nonlinear programming. The method can flexibly adapt to different terrains and the dynamic extension of the wildfire area. Lastly, the operation cost under extreme wildfire circumstances can be assessed upon the completion of the deployment. We applied our model to the wildfire data collected from eastern Victoria, Australia, and demonstrated its great potential in the real world.


title: Isomer: Transfer enhanced Dual-Channel Heterogeneous Dependency Attention Network for Aspect-based Sentiment Classification

abstract: Aspect-based sentiment classification aims to predict the sentiment polarity of a specific aspect in a sentence. However, most existing methods attempt to construct dependency relations into a homogeneous dependency graph with the sparsity and ambiguity, which cannot cover the comprehensive contextualized features of short texts or consider any additional node types or semantic relation information. To solve those issues, we present a sentiment analysis model named Isomer, which performs a dual-channel attention on heterogeneous dependency graphs incorporating external knowledge, to effectively integrate other additional information. Specifically, a transfer-enhanced dual-channel heterogeneous dependency attention network is devised in Isomer to model short texts using heterogeneous dependency graphs. These heterogeneous dependency graphs not only consider different types of information but also incorporate external knowledge. Experiments studies show that our model outperforms recent models on benchmark datasets. Furthermore, the results suggest that our method captures the importance of various information features to focus on informative contextual words.


title: Bounded Distance-control for Multi-UAV Formation Safety and Preservation in Target-tracking Applications

abstract: The notion of safety in multi-agent systems assumes great significance in many emerging collaborative multi-robot applications. In this paper, we present a multi-UAV collaborative target-tracking application by defining bounded inter-UAV distances in the formation in order to ensure safe operation. In doing so, we address the problem of prioritizing specific objectives over others in a multi-objective control framework. We propose a barrier Lyapunov function-based distributed control law to enforce the bounds on the distances and assess its Lyapunov stability using a kinematic model. The theoretical analysis is supported by numerical results, which account for measurement noise and moving targets. Straight-line and circular motion of the target are considered, and results for quadratic Lyapunov function-based control, often used in multi-agent multi-objective problems, are also presented. A comparison of the two control approaches elucidates the advantages of our proposed safe-control in bounding the inter-agent distances in a formation. A concluding evaluation using ROS simulations illustrates the practical applicability of the proposed control to a pair of multi-rotors visually estimating and maintaining their mutual separation within specified bounds, as they track a moving target.


title: Deconfounding Temporal Autoencoder: Estimating Treatment Effects over Time Using Noisy Proxies

abstract: Estimating individualized treatment effects (ITEs) from observational data is crucial for decision-making. In order to obtain unbiased ITE estimates, a common assumption is that all confounders are observed. However, in practice, it is unlikely that we observe these confounders directly. Instead, we often observe noisy measurements of true confounders, which can serve as valid proxies. In this paper, we address the problem of estimating ITE in the longitudinal setting where we observe noisy proxies instead of true confounders. To this end, we develop the Deconfounding Temporal Autoencoder, a novel method that leverages observed noisy proxies to learn a hidden embedding that reflects the true hidden confounders. In particular, the DTA combines a long short-term memory autoencoder with a causal regularization penalty that renders the potential outcomes and treatment assignment conditionally independent given the learned hidden embedding. Once the hidden embedding is learned via DTA, state-of-the-art outcome models can be used to control for it and obtain unbiased estimates of ITE. Using synthetic and real-world medical data, we demonstrate the effectiveness of our DTA by improving over state-of-the-art benchmarks by a substantial margin.


title: Transformer-based Korean Pretrained Language Models: A Survey on Three Years of Progress

abstract: With the advent of Transformer, which was used in translation models in 2017, attention-based architectures began to attract attention. Furthermore, after the emergence of BERT, which strengthened the NLU-specific encoder part, which is a part of the Transformer, and the GPT architecture, which strengthened the NLG-specific decoder part, various methodologies, data, and models for learning the Pretrained Language Model began to appear. Furthermore, in the past three years, various Pretrained Language Models specialized for Korean have appeared. In this paper, we intend to numerically and qualitatively compare and analyze various Korean PLMs released to the public.


title: Universal amplitudes ratios for critical aging via functional renormalization group

abstract: We discuss how to calculate non-equilibrium universal amplitude ratios in the functional renormalization group approach, extending its applicability. In particular, we focus on the critical relaxation of the Ising model with non-conserved dynamics (model A) and calculate the universal amplitude ratio associated with the fluctuation-dissipation ratio of the order parameter, considering a critical quench from a high-temperature initial condition. Our predictions turn out to be in good agreement with previous perturbative renormalization-group calculations and Monte Carlo simulations.


title: Persistence for a class of order-one autoregressive processes and Mallows-Riordan polynomials

abstract: We establish exact formulae for the persistence probabilities of an AR(1) sequence with symmetric uniform innovations in terms of certain families of polynomials, most notably a family introduced by Mallows and Riordan as enumerators of finite labeled trees when ordered by inversions. The connection of these polynomials with the volumes of certain polytopes is also discussed. Two further results provide factorizations of general AR(1) models, one for negative drifts with continuous innovations, and one for positive drifts with continuous and symmetric innovations. The second factorization extends a classical universal formula of Sparre Andersen for symmetric random walks. Our results also lead to explicit asymptotic estimates for the persistence probabilities.


title: Engineering of Intrinsic Chiral Torques in Magnetic Thin Films Based on the Dzyaloshinskii-Moriya Interaction

abstract: The establishment of chiral coupling in thin magnetic films with inhomogeneous anisotropy has led to the development of artificial systems of fundamental and technological interest. The chiral coupling itself is enabled by the Dzyaloshinskii-Moriya interaction (DMI) enforced by the patterned noncollinear magnetization. Here, we create a domain wall track with out-of-plane magnetization coupled on each side to a narrow parallel strip with in-plane magnetization. With this we show that the chiral torques emerging from the DMI at the boundary between the regions of noncollinear magnetization in a single magnetic layer can be used to bias the domain wall velocity. To tune the chiral torques, the design of the magnetic racetracks can be modified by varying the width of the tracks or the width of the transition region between noncollinear magnetizations, reaching effective chiral magnetic fields of up to 7.8 mT. Furthermore, we show how the magnitude of the chiral torques can be estimated by measuring asymmetric domain wall velocities, and demonstrate spontaneous domain wall motion propelled by intrinsic torques even in the absence of any external driving force.


title: Min-max theorem for the game of Cops and Robber on geodesic spaces

abstract: The game of Cops and Robber is traditionally played on a finite graph. The purpose of this note is to introduce and analyze the game that is played on an arbitrary geodesic space. The game is defined in such a way that it preserves the beauty and power of discrete games played on graphs and also keeps the specialties of the pursuit-evasion games played on polyhedral complexes. It is shown that the game can be approximated by finite games of discrete type and as a consequence a min-max theorem is obtained.


title: Navigating stellar wobbles for imaging with the solar gravitational lens

abstract: The solar gravitational lens (SGL) offers unique capabilities for high-resolution imaging of faint, distant objects, such as exoplanets. In the near future, a spacecraft carrying a meter-class telescope with a solar coronagraph would be placed in the focal region of the SGL. That region begins at ~547 astronomical units from the Sun and occupies the vicinity of the target-specific primary optical axis - the line that connects the center of the target and that of the Sun. This axis undergoes complex motion as the exoplanet orbits its host star, as that star moves with respect to the Sun, and even as the Sun itself moves with respect to the solar system's barycenter due to the gravitational pull of planets in our solar system. An image of an extended object is projected by the SGL into an image plane and moves within that plane, responding to the motion of the optical axis. To sample the image, a telescope must follow the projection with precise knowledge of its own position with respect to the image. We consider the dominant motions that determine the position of the focal line as a function of time. We evaluate the needed navigational capability for the telescope to conduct a multiyear exoplanet imaging mission. We show that even in a rather conservative case, when an Earth-like exoplanet is in our stellar neighborhood at $\sim10$ light years, the motion of the image is characterized by a small total acceleration $\sim 6.1\,\mu {\rm m/s}^2$ that is driven primarily by the orbital motion of the exoplanet and by the reflex motion of our Sun. We discuss how the amplified light of the host star allows establishing a local reference frame thus relaxing navigational requirements. We conclude that the required navigation in the SGL's focal region, although complex, can be accurately modeled and a $\sim 10$-year imaging mission is achievable with the already available propulsion technology.

categories: gr-qc astro-ph.EP astro-ph.GA astro-ph.IM astro-ph.SR


title: Temporal-Spatial Causal Interpretations for Vision-Based Reinforcement Learning

abstract: Deep reinforcement learning (RL) agents are becoming increasingly proficient in a range of complex control tasks. However, the agent's behavior is usually difficult to interpret due to the introduction of black-box function, making it difficult to acquire the trust of users. Although there have been some interesting interpretation methods for vision-based RL, most of them cannot uncover temporal causal information, raising questions about their reliability. To address this problem, we present a temporal-spatial causal interpretation (TSCI) model to understand the agent's long-term behavior, which is essential for sequential decision-making. TSCI model builds on the formulation of temporal causality, which reflects the temporal causal relations between sequential observations and decisions of RL agent. Then a separate causal discovery network is employed to identify temporal-spatial causal features, which are constrained to satisfy the temporal causality. TSCI model is applicable to recurrent agents and can be used to discover causal features with high efficiency once trained. The empirical results show that TSCI model can produce high-resolution and sharp attention masks to highlight task-relevant temporal-spatial information that constitutes most evidence about how vision-based RL agents make sequential decisions. In addition, we further demonstrate that our method is able to provide valuable causal interpretations for vision-based RL agents from the temporal perspective.


title: Electronic structure effects in the electron bremsstrahlung from heavy ions

abstract: A fully relativistic approach is presented for the calculation of the bremsstrahlung emitted by an electron scattered off an ionic target. The ionic target is described as a combination of an effective Coulomb potential and a finite-range potential induced by the electronic cloud of the ion. The approach allows us to investigate the influence of the electronic structure of the target on the properties of the emitted radiation. We calculate the double differential cross-section and Stokes parameters of the bremsstrahlung of an electron scattered off uranium ions in different charge states, ranging from bare to neutral uranium. Results on the high-energy endpoint of the electron bremsstrahlung from Li-like uranium ions ${\rm U}^{89+}$ are compared to the recent experimental data. For this process, it is found that taking into account the electronic structure of the target results in modification of the cross-section on the level of 14%, which can, in principle, be seen in present-day experiments.


title: Physical-chemical characterization of a PEEK surface irradiated with electron beams

abstract: The changes of surface structure, induced by electron beam irradiation (EBI) on the surface of poly(aryl-ether-ether-ketone) (PEEK), were investigated by using a range of various experimental techniques, such as tribology, Raman, AFM, NMR, FTIR. The topography of the surface layers PEEK irradiated with electron beams was established by X-ray diffraction (XRD). The electron irradiation resulted in degradation of the structure and composition of the irradiated zone was determined and segregation of elements was studied.


title: A Methodology for Thermal Simulation of Interconnects Enabled by Model Reduction with Material Property Variation

abstract: A thermal simulation methodology is developed for interconnects enabled by a data-driven learning algorithm accounting for variations of material properties, heat sources and boundary conditions (BCs). The methodology is based on the concepts of model order reduction and domain decomposition to construct a multi-block approach. A generic block model is built to represent a group of interconnect blocks that are used to wire standard cells in the integrated circuits (ICs). The blocks in this group possess identical geometry with various metal/via routings. The data-driven model reduction method is thus applied to learn material property variations induced by different metal/via routings in the blocks, in addition to the variations of heat sources and BCs. The approach is investigated in two very different settings. It is first applied to thermal simulation of a single interconnect block with similar BCs to those in the training of the generic block. It is then implemented in multi-block thermal simulation of a FinFET IC, where the interconnect structure is partitioned into several blocks each modeled by the generic block model. Accuracy of the generic block model is examined in terms of the metal/via routings, BCs and thermal discontinuities at the block interfaces.


title: Domain-oriented Language Pre-training with Adaptive Hybrid Masking and Optimal Transport Alignment

abstract: Motivated by the success of pre-trained language models such as BERT in a broad range of natural language processing (NLP) tasks, recent research efforts have been made for adapting these models for different application domains. Along this line, existing domain-oriented models have primarily followed the vanilla BERT architecture and have a straightforward use of the domain corpus. However, domain-oriented tasks usually require accurate understanding of domain phrases, and such fine-grained phrase-level knowledge is hard to be captured by existing pre-training scheme. Also, the word co-occurrences guided semantic learning of pre-training models can be largely augmented by entity-level association knowledge. But meanwhile, by doing so there is a risk of introducing noise due to the lack of groundtruth word-level alignment. To address the above issues, we provide a generalized domain-oriented approach, which leverages auxiliary domain knowledge to improve the existing pre-training framework from two aspects. First, to preserve phrase knowledge effectively, we build a domain phrase pool as auxiliary training tool, meanwhile we introduce Adaptive Hybrid Masked Model to incorporate such knowledge. It integrates two learning modes, word learning and phrase learning, and allows them to switch between each other. Second, we introduce Cross Entity Alignment to leverage entity association as weak supervision to augment the semantic learning of pre-trained models. To alleviate the potential noise in this process, we introduce an interpretable Optimal Transport based approach to guide alignment learning. Experiments on four domain-oriented tasks demonstrate the superiority of our framework.


title: Investigating the Impact of 9/11 on The Simpsons through Natural Language Processing

abstract: The impact of real world events on fictional media is particularly apparent in the American cartoon series The Simpsons. While there are often very direct pop culture references evident in the dialogue and visual gags of the show, subtle changes in tone or sentiment may not be so obvious. Our aim was to use Natural Language Processing to attempt to search for changes in word frequency, topic, and sentiment before and after the September 11 terrorist attacks in New York. No clear trend change was seen, there was a slight decrease in the average sentiment over time around the relevant period between 2000 and 2002, but the scripts still maintained an overall positive value, indicating that the comedic nature of The Simpsons did not wane particularly significantly. The exploration of other social issues and even specific character statistics is needed to bolster the findings here.


title: On the algebraic structures of the space of interval-valued intuitionistic fuzzy numbers

abstract: This study is inspired by those of Huang et al. (Soft Comput. 25, 2513--2520, 2021) and Wang et al. (Inf. Sci. 179, 3026--3040, 2009) in which some ranking techniques for interval-valued intuitionistic fuzzy numbers (IVIFNs) were introduced. In this study, we prove that the space of all IVIFNs with the relation in the method for comparing any two IVIFNs based on a score function and three types of entropy functions is a complete chain and obtain that this relation is an admissible order. Moreover, we demonstrate that IVIFNs are complete chains to the relation in the comparison method for IVIFNs on the basis of score, accuracy, membership uncertainty index, and hesitation uncertainty index functions.