title: Emotion Recognition among Couples: A Survey

abstract: Couples' relationships affect the physical health and emotional well-being of partners. Automatically recognizing each partner's emotions could give a better understanding of their individual emotional well-being, enable interventions and provide clinical benefits. In the paper, we summarize and synthesize works that have focused on developing and evaluating systems to automatically recognize the emotions of each partner based on couples' interaction or conversation contexts. We identified 28 articles from IEEE, ACM, Web of Science, and Google Scholar that were published between 2010 and 2021. We detail the datasets, features, algorithms, evaluation, and results of each work as well as present main themes. We also discuss current challenges, research gaps and propose future research directions. In summary, most works have used audio data collected from the lab with annotations done by external experts and used supervised machine learning approaches for binary classification of positive and negative affect. Performance results leave room for improvement with significant research gaps such as no recognition using data from daily life. This survey will enable new researchers to get an overview of this field and eventually enable the development of emotion recognition systems to inform interventions to improve the emotional well-being of couples.


title: Fixed point annihilation for a spin in a fluctuating field

abstract: A quantum spin impurity coupled to a critical free field (the Bose-Kondo model) can be represented as a 0+1D field theory with long-range-in-time interactions that decay as $|t-t'|^{-(2-\delta)}$. This theory is a simpler analogue of nonlinear sigma models with topological Wess-Zumino-Witten terms in higher dimensions. In this note we show that the RG flows for the impurity problem exhibit an annihilation between two nontrivial RG fixed points at a critical value $\delta_c$ of the interaction exponent. The calculation is controlled at large spin $S$. This clarifies the phase diagram of the Bose-Kondo model and shows that it serves as a toy model for phenomena involving fixed-point annihilation and "quasiuniversality" in higher dimensions.


title: AKB-48: A Real-World Articulated Object Knowledge Base

abstract: Human life is populated with articulated objects. A comprehensive understanding of articulated objects, namely appearance, structure, physics property, and semantics, will benefit many research communities. As current articulated object understanding solutions are usually based on synthetic object dataset with CAD models without physics properties, which prevent satisfied generalization from simulation to real-world applications in visual and robotics tasks. To bridge the gap, we present AKB-48: a large-scale Articulated object Knowledge Base which consists of 2,037 real-world 3D articulated object models of 48 categories. Each object is described by a knowledge graph ArtiKG. To build the AKB-48, we present a fast articulation knowledge modeling (FArM) pipeline, which can fulfill the ArtiKG for an articulated object within 10-15 minutes, and largely reduce the cost for object modeling in the real world. Using our dataset, we propose AKBNet, a novel integral pipeline for Category-level Visual Articulation Manipulation (C-VAM) task, in which we benchmark three sub-tasks, namely pose estimation, object reconstruction and manipulation. Dataset, codes, and models will be publicly available at https://liuliu66.github.io/articulationobjects/.


title: ADD 2022: the First Audio Deep Synthesis Detection Challenge

abstract: Audio deepfake detection is an emerging topic, which was included in the ASVspoof 2021. However, the recent shared tasks have not covered many real-life and challenging scenarios. The first Audio Deep synthesis Detection challenge (ADD) was motivated to fill in the gap. The ADD 2022 includes three tracks: low-quality fake audio detection (LF), partially fake audio detection (PF) and audio fake game (FG). The LF track focuses on dealing with bona fide and fully fake utterances with various real-world noises etc. The PF track aims to distinguish the partially fake audio from the real. The FG track is a rivalry game, which includes two tasks: an audio generation task and an audio fake detection task. In this paper, we describe the datasets, evaluation metrics, and protocols. We also report major findings that reflect the recent advances in audio deepfake detection tasks.


title: A Survey of Explainable Reinforcement Learning

abstract: Explainable reinforcement learning (XRL) is an emerging subfield of explainable machine learning that has attracted considerable attention in recent years. The goal of XRL is to elucidate the decision-making process of learning agents in sequential decision-making settings. In this survey, we propose a novel taxonomy for organizing the XRL literature that prioritizes the RL setting. We overview techniques according to this taxonomy. We point out gaps in the literature, which we use to motivate and outline a roadmap for future work.


title: Redshift space distortions in Lagrangian space and the linear large scale velocity field of dark matter

abstract: Untangling the connection between redshift space coordinates, a velocity measurement, and three dimensional real space coordinates, is a cosmological problem that is often modeled through a linear understanding of the velocity-position coupling. This linear information is better preserved in the Lagrangian space picture of the matter density field. Through Lagrangian space measurements, we can extract more information and make more accurate estimates of the linear growth rate of the universe. In this paper, we address the linear modelling of matter particle velocities through transfer functions, and in doing so examine to what degree the decrease in correlation with initial conditions may be contaminated by velocity-based nonlinearities. With a thorough analysis of the monopole-quadrupole ratio, we find the best-fit value for the Eulerian velocity dispersion, $\sigma_p = 378.3$ km/s. The covariance of the cosmological linear growth rate $f$, is estimated in the Eulerian and Lagrangian cases. Comparing Lagrangian and Eulerian, we find that the error in $f$ improves by a factor of 3, without the need for nonlinear velocity dispersion modelling.


title: PENCIL: Deep Learning with Noisy Labels

abstract: Deep learning has achieved excellent performance in various computer vision tasks, but requires a lot of training examples with clean labels. It is easy to collect a dataset with noisy labels, but such noise makes networks overfit seriously and accuracies drop dramatically. To address this problem, we propose an end-to-end framework called PENCIL, which can update both network parameters and label estimations as label distributions. PENCIL is independent of the backbone network structure and does not need an auxiliary clean dataset or prior information about noise, thus it is more general and robust than existing methods and is easy to apply. PENCIL can even be used repeatedly to obtain better performance. PENCIL outperforms previous state-of-the-art methods by large margins on both synthetic and real-world datasets with different noise types and noise rates. And PENCIL is also effective in multi-label classification tasks through adding a simple attention structure on backbone networks. Experiments show that PENCIL is robust on clean datasets, too.


title: Visual attention analysis of pathologists examining whole slide images of Prostate cancer

abstract: We study the attention of pathologists as they examine whole-slide images (WSIs) of prostate cancer tissue using a digital microscope. To the best of our knowledge, our study is the first to report in detail how pathologists navigate WSIs of prostate cancer as they accumulate information for their diagnoses. We collected slide navigation data (i.e., viewport location, magnification level, and time) from 13 pathologists in 2 groups (5 genitourinary (GU) specialists and 8 general pathologists) and generated visual attention heatmaps and scanpaths. Each pathologist examined five WSIs from the TCGA PRAD dataset, which were selected by a GU pathology specialist. We examined and analyzed the distributions of visual attention for each group of pathologists after each WSI was examined. To quantify the relationship between a pathologist's attention and evidence for cancer in the WSI, we obtained tumor annotations from a genitourinary specialist. We used these annotations to compute the overlap between the distribution of visual attention and annotated tumor region to identify strong correlations. Motivated by this analysis, we trained a deep learning model to predict visual attention on unseen WSIs. We find that the attention heatmaps predicted by our model correlate quite well with the ground truth attention heatmap and tumor annotations on a test set of 17 WSIs by using various spatial and temporal evaluation metrics.


title: Scattering Amplitudes: Celestial and Carrollian

abstract: Recent attempts at the construction of holography for asymptotically flat spacetimes have taken two different routes. Celestial holography, involving a two dimensional (2d) CFT dual to 4d Minkowski spacetime, has generated novel results in asymptotic symmetry and scattering amplitudes. A different formulation, using Carrollian CFTs, has been principally used to provide some evidence for flat holography in lower dimensions. Understanding of flatspace scattering has been lacking in the Carroll framework. In this work, using ideas from Celestial holography, we show that 3d Carrollian CFTs living on the null boundary of 4d flatspace can potentially compute bulk scattering amplitudes. 3d Carrollian conformal correlators have two different branches, one depending on the null time direction and one independent of it. We propose that it is the time-dependent branch that is related to bulk scattering. We construct an explicit field theoretic example of a free massless Carrollian scalar that realises some desired properties.


title: Galaxy Spectra neural Networks (GaSNets). I. Searching for strong lens candidates in eBOSS spectra using Deep Learning

abstract: With the advent of new spectroscopic surveys from ground and space, observing up to hundreds of millions of galaxies, spectra classification will become overwhelming for standard analysis techniques. To prepare for this challenge, we introduce a family of deep learning tools to classify features in one-dimensional spectra. As the first application of these Galaxy Spectra neural Networks (GaSNets), we focus on tools specialized at identifying emission lines from strongly lensed star-forming galaxies in the eBOSS spectra. We first discuss the training and testing of these networks and define a threshold probability, PL, of 95% for the high quality event detection. Then, using a previous set of spectroscopically selected strong lenses from eBOSS, confirmed with HST, we estimate a completeness of ~80% as the fraction of lenses recovered above the adopted PL. We finally apply the GaSNets to ~1.3M spectra to collect a first list of ~430 new high quality candidates identified with deep learning applied to spectroscopy and visually graded as highly probable real events. A preliminary check against ground-based observations tentatively shows that this sample has a confirmation rate of 38%, in line with previous samples selected with standard (no deep learning) classification tools and follow-up by Hubble Space Telescope. This first test shows that machine learning can be efficiently extended to feature recognition in the wavelength space, which will be crucial for future surveys like 4MOST, DESI, Euclid, and the Chinese Space Station Telescope (CSST).


title: Electrical conductivity of random metallic nanowire networks: An analytical consideration along with computer simulation

abstract: We have proposed an analytical model for the electrical conductivity in random, metallic, nanowire networks. We have mimicked such random nanowire networks as random resistor networks (RRN) produced by the homogeneous, isotropic, and random deposition of conductive zero-width sticks onto an insulating substrate. We studied the electrical conductivity of these RRNs using a mean-field approximation. An analytical dependency of the electrical conductivity on the main physical parameters (the number density and electrical resistances of these wires and of the junctions between them) has been derived. Computer simulations have been performed to validate our theoretical predictions. We computed the electrical conductivity of the RRNs against the number density of the conductive fillers for the junction-resistance-dominated case and for the case where the wire resistance and the junction resistance were equal. The results of the computations were compared with this mean-field approximation. Our computations demonstrated that our analytical expression correctly predicts the electrical conductivity across a wide range of number densities.


title: Modeling High-Dimensional Data with Unknown Cut Points: A Fusion Penalized Logistic Threshold Regression

abstract: In traditional logistic regression models, the link function is often assumed to be linear and continuous in predictors. Here, we consider a threshold model that all continuous features are discretized into ordinal levels, which further determine the binary responses. Both the threshold points and regression coefficients are unknown and to be estimated. For high dimensional data, we propose a fusion penalized logistic threshold regression (FILTER) model, where a fused lasso penalty is employed to control the total variation and shrink the coefficients to zero as a method of variable selection. Under mild conditions on the estimate of unknown threshold points, we establish the non-asymptotic error bound for coefficient estimation and the model selection consistency. With a careful characterization of the error propagation, we have also shown that the tree-based method, such as CART, fulfill the threshold estimation conditions. We find the FILTER model is well suited in the problem of early detection and prediction for chronic disease like diabetes, using physical examination data. The finite sample behavior of our proposed method are also explored and compared with extensive Monte Carlo studies, which supports our theoretical discoveries.


title: 2-2-holes simplified

abstract: Quadratic gravity illustrates how a replacement for black holes can emerge from a UV completion of gravity. 2-2-holes are extremely compact horizonless objects with an entropy $S_{22}$ due to trapped normal matter, and in this way they are conceptually easy to understand. But the field equations are cumbersome and the numerical analysis has so far been restricted to relatively small size solutions. Here we show how the properties of arbitrarily large 2-2-holes can be found, including the time delay for gravitational wave echoes and the result $T_\infty S_{22}=M/2$. The starting point is to formulate the metric in terms of the tortoise coordinate, and to have one of the two metric functions be a conformal factor. A large conformally-related volume becomes associated with the interior of a 2-2-hole. We also discuss implications for the weak gravity conjecture.


title: Two continuous (4, 5) pairs of explicit 9-stage Runge-Kutta methods

abstract: An 11-dimensional family of embedded (4, 5) pairs of explicit 9-stage Runge-Kutta methods with an interpolant of order 5 is derived. Two optimized for efficiency pairs are presented.


title: A Survey on Deep Reinforcement Learning-based Approaches for Adaptation and Generalization

abstract: Deep Reinforcement Learning (DRL) aims to create intelligent agents that can learn to solve complex problems efficiently in a real-world environment. Typically, two learning goals: adaptation and generalization are used for baselining DRL algorithm's performance on different tasks and domains. This paper presents a survey on the recent developments in DRL-based approaches for adaptation and generalization. We begin by formulating these goals in the context of task and domain. Then we review the recent works under those approaches and discuss future research directions through which DRL algorithms' adaptability and generalizability can be enhanced and potentially make them applicable to a broad range of real-world problems.


title: Extended MSO Model Checking via Small Vertex Integrity

abstract: We study the model checking problem of an extended $\mathsf{MSO}$ with local and global cardinality constraints, called $\mathsf{MSO}^{\mathsf{GL}}_{\mathsf{Lin}}$, introduced recently by Knop, Kouteck\'{y}, Masa\v{r}\'{i}k, and Toufar [Log. Methods Comput. Sci., 15(4), 2019]. We show that the problem is fixed-parameter tractable parameterized by vertex integrity, where vertex integrity is a graph parameter standing between vertex cover number and treedepth. Our result thus narrows the gap between the fixed-parameter tractability parameterized by vertex cover number and the W[1]-hardness parameterized by treedepth.


title: MeNTT: A Compact and Efficient Processing-in-Memory Number Theoretic Transform (NTT) Accelerator

abstract: Lattice-based cryptography (LBC) exploiting Learning with Errors (LWE) problems is a promising candidate for post-quantum cryptography. Number theoretic transform (NTT) is the latency- and energy- dominant process in the computation of LWE problems. This paper presents a compact and efficient in-MEmory NTT accelerator, named MeNTT, which explores optimized computation in and near a 6T SRAM array. Specifically-designed peripherals enable fast and efficient modular operations. Moreover, a novel mapping strategy reduces the data flow between NTT stages into a unique pattern, which greatly simplifies the routing among processing units (i.e., SRAM column in this work), reducing energy and area overheads. The accelerator achieves significant latency and energy reductions over prior arts.


title: RePair Grammars are the Smallest Grammars for Fibonacci Words

abstract: Grammar-based compression is a loss-less data compression scheme that represents a given string $w$ by a context-free grammar that generates only $w$. While computing the smallest grammar which generates a given string $w$ is NP-hard in general, a number of polynomial-time grammar-based compressors which work well in practice have been proposed. RePair, proposed by Larsson and Moffat in 1999, is a grammar-based compressor which recursively replaces all possible occurrences of a most frequently occurring bigrams in the string. Since there can be multiple choices of the most frequent bigrams to replace, different implementations of RePair can result in different grammars. In this paper, we show that the smallest grammars generating the Fibonacci words $F_k$ can be completely characterized by RePair, where $F_k$ denotes the $k$-th Fibonacci word. Namely, all grammars for $F_k$ generated by any implementation of RePair are the smallest grammars for $F_k$, and no other grammars can be the smallest for $F_k$. To the best of our knowledge, Fibonacci words are the first non-trivial infinite family of strings for which RePair is optimal.


title: FM Band Channel Measurements and Modeling

abstract: As FM coverage is so ubiquitous around the world, several applications can be considered to better exploit this useful band. Thus, it is of significant interest to investigate and characterize channel properties of the FM Band for the potential two-way digital wireless systems. In this paper, we present the results of field measurements at 86 MHz conducted at Gebze, Kocaeli, Turkey. Through the measurements, some of the FM channel characteristics are identified. Measurements are performed for urban, hilly terrain, and rural areas. Our results show that the FM channel expectedly has a large coverage area but at the same time, it possesses large channel excess delays. While most of COST-207 channel power delay profile models are also applicable for the FM Band, for urban environments and hilly terrain environments, channel clusters and excess delays are higher than those of COST-207 models. As 5G systems aim to utilize lower frequency bands for supplementary links, FM Band can be considered as one of the potential bands and the channel models proposed in this study can then be exploited for performance analysis.


title: V2X-Sim: Multi-Agent Collaborative Perception Dataset and Benchmark for Autonomous Driving

abstract: Vehicle-to-everything (V2X) communication techniques enable the collaboration between vehicles and many other entities in the neighboring environment, which could fundamentally improve the perception system for autonomous driving. However, the lack of a public dataset significantly restricts the research progress of collaborative perception. To fill this gap, we present V2X-Sim, a comprehensive simulated multi-agent perception dataset for V2X-aided autonomous driving. V2X-Sim provides: (1) \hl{multi-agent} sensor recordings from the road-side unit (RSU) and multiple vehicles that enable collaborative perception, (2) multi-modality sensor streams that facilitate multi-modality perception, and (3) diverse ground truths that support various perception tasks. Meanwhile, we build an open-source testbed and provide a benchmark for the state-of-the-art collaborative perception algorithms on three tasks, including detection, tracking and segmentation. V2X-Sim seeks to stimulate collaborative perception research for autonomous driving before realistic datasets become widely available. Our dataset and code are available at \url{https://ai4ce.github.io/V2X-Sim/}.


title: Design-Bench: Benchmarks for Data-Driven Offline Model-Based Optimization

abstract: Black-box model-based optimization (MBO) problems, where the goal is to find a design input that maximizes an unknown objective function, are ubiquitous in a wide range of domains, such as the design of proteins, DNA sequences, aircraft, and robots. Solving model-based optimization problems typically requires actively querying the unknown objective function on design proposals, which means physically building the candidate molecule, aircraft, or robot, testing it, and storing the result. This process can be expensive and time consuming, and one might instead prefer to optimize for the best design using only the data one already has. This setting -- called offline MBO -- poses substantial and different algorithmic challenges than more commonly studied online techniques. A number of recent works have demonstrated success with offline MBO for high-dimensional optimization problems using high-capacity deep neural networks. However, the lack of standardized benchmarks in this emerging field is making progress difficult to track. To address this, we present Design-Bench, a benchmark for offline MBO with a unified evaluation protocol and reference implementations of recent methods. Our benchmark includes a suite of diverse and realistic tasks derived from real-world optimization problems in biology, materials science, and robotics that present distinct challenges for offline MBO. Our benchmark and reference implementations are released at github.com/rail-berkeley/design-bench and github.com/rail-berkeley/design-baselines.


title: Modular representations of finite groups and Lie theory

abstract: This article discusses the modular representation theory of finite groups of Lie type from the viewpoint of Broue's abelian defect group conjecture. We discuss both the defining characteristic case, the inspiration for Alperin's weight conjecture, and the non-defining case, the inspiration for Broue's conjecture. The modular representation theory of general finite groups is conjectured to behave both like that of finite groups of Lie type in defining characteristic, and in non-defining characteristic, to a large extent. The expected behaviour of modular representation theory of finite groups of Lie type in defining characteristic is particularly difficult to grasp along the lines of Broue's conjecture and we raise a new question related to the change of central character. We introduce a degeneration method in the modular representation theory of finite groups of Lie type in non-defining characteristic. Combined with the rigidity property of perverse equivalences, this provides a setting for two variable decomposition matrices, for large characteristic. This should help make progress towards finding decomposition matrices, an outstanding problem with few general results beyond the case of general linear groups. This last part is based on joint work with David Craven and Olivier Dudas.


title: PCB Component Detection using Computer Vision for Hardware Assurance

abstract: Printed Circuit Board (PCB) assurance in the optical domain is a crucial field of study. Though there are many existing PCB assurance methods using image processing, computer vision (CV), and machine learning (ML), the PCB field is complex and increasingly evolving so new techniques are required to overcome the emerging problems. Existing ML-based methods outperform traditional CV methods, however they often require more data, have low explainability, and can be difficult to adapt when a new technology arises. To overcome these challenges, CV methods can be used in tandem with ML methods. In particular, human-interpretable CV algorithms such as those that extract color, shape, and texture features increase PCB assurance explainability. This allows for incorporation of prior knowledge, which effectively reduce the number of trainable ML parameters and thus, the amount of data needed to achieve high accuracy when training or retraining an ML model. Hence, this study explores the benefits and limitations of a variety of common computer vision-based features for the task of PCB component detection using semantic data. Results of this study indicate that color features demonstrate promising performance for PCB component detection. The purpose of this paper is to facilitate collaboration between the hardware assurance, computer vision, and machine learning communities.


title: TraSeTR: Track-to-Segment Transformer with Contrastive Query for Instance-level Instrument Segmentation in Robotic Surgery

abstract: Surgical instrument segmentation -- in general a pixel classification task -- is fundamentally crucial for promoting cognitive intelligence in robot-assisted surgery (RAS). However, previous methods are struggling with discriminating instrument types and instances. To address the above issues, we explore a mask classification paradigm that produces per-segment predictions. We propose TraSeTR, a novel Track-to-Segment Transformer that wisely exploits tracking cues to assist surgical instrument segmentation. TraSeTR jointly reasons about the instrument type, location, and identity with instance-level predictions i.e., a set of class-bbox-mask pairs, by decoding query embeddings. Specifically, we introduce the prior query that encoded with previous temporal knowledge, to transfer tracking signals to current instances via identity matching. A contrastive query learning strategy is further applied to reshape the query feature space, which greatly alleviates the tracking difficulty caused by large temporal variations. The effectiveness of our method is demonstrated with state-of-the-art instrument type segmentation results on three public datasets, including two RAS benchmarks from EndoVis Challenges and one cataract surgery dataset CaDIS.


title: Consecutive topological phase transitions and colossal magnetoresistance in a magnetic topological semimetal

abstract: The combination of magnetic symmetries and electronic band topology provides a promising route for realizing topologically nontrivial quasiparticles, and the manipulation of magnetic structures may enable the switching between topological phases, with the potential for achieving functional physical properties. Here, we report measurements of the electrical resistivity of EuCd$_2$As$_2$ under pressure, which show an intriguing insulating dome at pressures between $p_{\rm c1}\sim1.0$~GPa and $p_{\rm c2}\sim2.0$~GPa, situated between two regimes with metallic transport. The insulating state can be fully suppressed by a small magnetic field, leading to a colossal negative magnetoresistance on the order of $10^5$\%, accessible via a modest field of $\sim0.2$~T. First-principles calculations reveal that the dramatic evolution of the resistivity under pressure is due to consecutive transitions of EuCd$_2$As$_2$ from a magnetic topological insulator to a trivial insulator, and then to a Weyl semimetal, with the latter resulting from a pressure-induced change in the magnetic ground state. Similarly, the colossal magnetoresistance results from a field-induced polarization of the magnetic moments, transforming EuCd$_2$As$_2$ from a trivial insulator to a Weyl semimetal. These findings underscore weak magnetic exchange couplings and spin anisotropy as ingredients for discovering tunable magnetic topological materials with desirable functionalities.


title: Transformer for Graphs: An Overview from Architecture Perspective

abstract: Recently, Transformer model, which has achieved great success in many artificial intelligence fields, has demonstrated its great potential in modeling graph-structured data. Till now, a great variety of Transformers has been proposed to adapt to the graph-structured data. However, a comprehensive literature review and systematical evaluation of these Transformer variants for graphs are still unavailable. It's imperative to sort out the existing Transformer models for graphs and systematically investigate their effectiveness on various graph tasks. In this survey, we provide a comprehensive review of various Graph Transformer models from the architectural design perspective. We first disassemble the existing models and conclude three typical ways to incorporate the graph information into the vanilla Transformer: 1) GNNs as Auxiliary Modules, 2) Improved Positional Embedding from Graphs, and 3) Improved Attention Matrix from Graphs. Furthermore, we implement the representative components in three groups and conduct a comprehensive comparison on various kinds of famous graph data benchmarks to investigate the real performance gain of each component. Our experiments confirm the benefits of current graph-specific modules on Transformer and reveal their advantages on different kinds of graph tasks.


title: MLP-ASR: Sequence-length agnostic all-MLP architectures for speech recognition

abstract: We propose multi-layer perceptron (MLP)-based architectures suitable for variable length input. MLP-based architectures, recently proposed for image classification, can only be used for inputs of a fixed, pre-defined size. However, many types of data are naturally variable in length, for example, acoustic signals. We propose three approaches to extend MLP-based architectures for use with sequences of arbitrary length. The first one uses a circular convolution applied in the Fourier domain, the second applies a depthwise convolution, and the final relies on a shift operation. We evaluate the proposed architectures on an automatic speech recognition task with the Librispeech and Tedlium2 corpora. The best proposed MLP-based architectures improves WER by 1.0 / 0.9%, 0.9 / 0.5% on Librispeech dev-clean/dev-other, test-clean/test-other set, and 0.8 / 1.1% on Tedlium2 dev/test set using 86.4% the size of self-attention-based architecture.


title: Approximation of solutions to parabolic Lam\'e type operators in cylinder domains and Carleman's formulas for them

abstract: Let $s \in {\mathbb N}$, $T_1,T_2 \in {\mathbb R}$, $T_1<T_2$, and let $\Omega, \omega $ be bounded domains in ${\mathbb R}^n$, $n \geq 1$ such that $\omega \subset \Omega$ and the complement $\Omega \setminus \omega$ have no non-empty compact components in $\Omega$. We investigate the problem of approximation of solutions to parabolic Lam\'e type system from the Lebesgue class $L^2(\omega \times (T_1,T_2))$ in a cylinder domain $\omega \times (T_1,T_2) \subset {\mathbb R}^{n+1}$ by more regular solutions in a bigger domain $\Omega \times (T_1,T_2)$. As an application of the obtained approximation theorems we construct Carleman's formulas for recovering solutions to these parabolic operators from the Sobolev class $H^{2s,s}(\Omega \times (T_1,T_2))$ via values the solutions on a part of the lateral surface of the cylinder and the corresponding them stress tensors.


title: Wearable SELD dataset: Dataset for sound event localization and detection using wearable devices around head

abstract: Sound event localization and detection (SELD) is a combined task of identifying the sound event and its direction. Deep neural networks (DNNs) are utilized to associate them with the sound signals observed by a microphone array. Although ambisonic microphones are popular in the literature of SELD, they might limit the range of applications due to their predetermined geometry. Some applications (including those for pedestrians that perform SELD while walking) require a wearable microphone array whose geometry can be designed to suit the task. In this paper, for the development of such a wearable SELD, we propose a dataset named Wearable SELD dataset. It consists of data recorded by 24 microphones placed on a head and torso simulators (HATS) with some accessories mimicking wearable devices (glasses, earphones, and headphones). We also provide experimental results of SELD using the proposed dataset and SELDNet to investigate the effect of microphone configuration.


title: Warm Dark Matter from Higher-Dimensional Gauge Theories

abstract: Warm dark matter particles with masses in the keV range have been linked with the large group representations in gauge theories through a high number of species at decoupling. In this paper, we address WDM fermionic degrees of freedom from such representations. Bridging higher-dimensional particle physics theories with cosmology studies and astrophysical observations, our approach is two-folded, i.e., it includes realistic models from higher-dimensional representations and constraints from simulations tested against observations. Starting with superalgebras in exceptional periodicity theories, we discuss several symmetry reductions and we consider several representations that accommodate a high number of degrees of freedom. We isolate a model that naturally accommodates both the standard model representation and the fermionic dark matter in agreement with both large and small-scale constraints. This model considers an intersection of branes in $D=27+3$ in a manner that provides the degrees of freedom for the standard model on one hand and 2048 fermionic degrees of freedom for dark matter, corresponding to a $\sim$2 keV particle mass, on the other. In this context, we discuss the theoretical implications and the observable predictions.


title: Dressed black holes in the new tensor-vector-scalar theory

abstract: As incarnations of gravity in its prime, black holes are arguably the best target for us to demystify gravity. Keeping in mind the prominent role black holes play in gravitational wave astronomy, it becomes a must for a theory to possess black hole solutions with only measurable departures from their general relativity counterparts. In this paper, we present black holes in a tensor-vector-scalar representation of relativistic modified Newtonian dynamics. We find that the theory allows Schwarzschild and nearly-Schwarzschild black holes as solutions, while the nontrivial scalar and vector fields generally diverge at the event horizon. Whether this is a physical pathology or not poses a challenge for these solutions, and by extension, the model. However, even if it is, this pathology could be overcome when the black hole hair vanishes.


title: The Gene of Scientific Success

abstract: This paper elaborates how to identify and evaluate causal factors to improve scientific impact. Currently, analyzing scientific impact can be beneficial to various academic activities including funding application, mentor recommendation, and discovering potential cooperators etc. It is universally acknowledged that high-impact scholars often have more opportunities to receive awards as an encouragement for their hard working. Therefore, scholars spend great efforts in making scientific achievements and improving scientific impact during their academic life. However, what are the determinate factors that control scholars' academic success? The answer to this question can help scholars conduct their research more efficiently. Under this consideration, our paper presents and analyzes the causal factors that are crucial for scholars' academic success. We first propose five major factors including article-centered factors, author-centered factors, venue-centered factors, institution-centered factors, and temporal factors. Then, we apply recent advanced machine learning algorithms and jackknife method to assess the importance of each causal factor. Our empirical results show that author-centered and article-centered factors have the highest relevancy to scholars' future success in the computer science area. Additionally, we discover an interesting phenomenon that the h-index of scholars within the same institution or university are actually very close to each other.


title: BCFT and Islands in Two Dimensions

abstract: By combining the AdS/BCFT correspondence and the brane world holography, we expect an equivalence relation between a boundary conformal field theory (BCFT) and a gravitational system coupled to a CFT. However, it still remains unclear how the boundary condition of the BCFT is translated in the gravitational system. We examine this duality relation in a two-dimensional setup by looking at the computation of entanglement entropy and energy flux conservation. We also identify the two-dimensional gravity which is dual to the boundary dynamics of a BCFT. Moreover, we show that by considering a gravity solution with scalar fields turned on, we can reproduce one point functions correctly in the AdS/BCFT.


title: A Creativity Survey of Parallel Sorting Algorithm

abstract: Sorting is one of the most fundamental problems in the field of computer science. With the rapid development of manycore processors, it shows great importance to design efficient parallel sort algorithm on manycore architecture. This paper studies the parallel memory sorting method on modern hardware, and summarizes its research status and progress. Classify the research problems, research methods and measurement methods of the target papers and references. In the end, we summarize all the researches and list the directions not researched and innovative places. Keywords: Sorting Algorithm, Parallel Algorithm, Parallel Optimization, CPU, GPU, Memory Hierarchy


title: Normal Cones Intersection Rule and Optimality Analysis for Low-Rank Matrix Optimization with Affine Manifolds

abstract: The low-rank matrix optimization with affine manifold (rank-MOA) aims to minimize a continuously differentiable function over a low-rank set intersecting with an affine manifold. This paper is devoted to the optimality analysis for rank-MOA. As a cornerstone, the intersection rule of the Fr\'{e}chet normal cone to the feasible set of the rank-MOA is established under some mild linear independence assumptions. Aided with the resulting explicit formulae of the underlying normal cone, the so-called F-stationary point and the \alpha-stationary point of rank-MOA are investigated and the relationship with local/global minimizers are then revealed in terms of first-order optimality conditions. Furthermore, the second-order optimality analysis, including the necessary and the sufficient conditions, is proposed based on the second-order differentiation information of the model. All these results will enrich the theory of low-rank matrix optimization and give potential clues to designing efficient numerical algorithms for seeking low rank solutions. Meanwhile, two specific applications of the rank-MOA are discussed to illustrate our proposed optimality analysis.


title: End-to-End Training for Back-Translation with Categorical Reparameterization Trick

abstract: Back-translation is an effective semi-supervised learning framework in neural machine translation (NMT). A pre-trained NMT model translates monolingual sentences and makes synthetic bilingual sentence pairs for the training of the other NMT model, and vice versa. Understanding the two NMT models as inference and generation models, respectively, previous works applied the training framework of variational auto-encoder (VAE). However, the discrete property of translated sentences prevents gradient information from flowing between the two NMT models. In this paper, we propose a categorical reparameterization trick that makes NMT models generate differentiable sentences so that the VAE's training framework can work in the end-to-end fashion. Our experiments demonstrate that our method effectively trains the NMT models and achieves better BLEU scores than the previous baseline on the datasets of the WMT translation task.


title: Insightful Mining Equilibria

abstract: The selfish mining attack, arguably the most famous game-theoretic attack in blockchain, indicates that the Bitcoin protocol is not incentive-compatible. Most subsequent works mainly focus on strengthening the selfish mining strategy, thus enabling a single strategic agent more likely to deviate. In sharp contrast, little attention has been paid to the resistant behavior against the selfish mining attack, let alone further equilibrium analysis for miners and mining pools in the blockchain as a multi-agent system. In this paper, first, we propose a strategy called insightful mining to counteract selfish mining. By infiltrating an undercover miner into the selfish pool, the insightful pool could acquire the number of its hidden blocks. We prove that, with this extra insight, the utility of the insightful pool could be strictly greater than the selfish pool's when they have the same mining power. Then we investigate the mining game where all pools can either choose to be honest or take the insightful mining strategy. We characterize the Nash equilibrium of this mining game, and derive three corollaries: (a) each mining game has a pure Nash equilibrium; (b) honest mining is a Nash equilibrium if the largest mining pool has a fraction of mining power no more than 1/3; (c) there are at most two insightful pools under equilibrium no matter how the mining power is distributed.


title: Absolute and "upstream" convective instabilities in plane Couette-Poiseuille flow

abstract: Here we report some interesting new features of the spatio-temporal instability of the incompressible plane Couette-Poiseuille flow (CPF). First of all, this flow represents the first instance of a "non-inflectional" absolute instability, within constant-viscosity formulation, which is triggered when one of the plates moves opposite to the bulk motion. More strikingly, with further increase in the negative plate motion, the absolute instability ($\textrm{AI}$) transitions to an "upstream" convective instability ($\textrm{CI}^-$), wherein an unstable wave packet moves opposite to the direction of the bulk flow. Thus, the CPF exhibits a unique $\textrm{CI}^+ \to \textrm{AI} \to \textrm{CI}^-$ transition, for a given Reynolds number ($Re$), where $\textrm{CI}^+$ denotes the commonly-observed case of a "downstream" convective instability. This type of transition has not been reported for other known examples of absolutely unstable flows. We compute the leading and trailing edge velocities for an amplifying wave packet and find that, for the plane Poiseuille flow, both these velocities approach zero as $Re \to \infty$. As a result, at high $Re$, even the slightest of negative plate motions is sufficient to trigger $\textrm{AI}$ and subsequently $\textrm{CI}^-$, as observed for the CPF. The wave-packet dispersion first increases with $Re$, followed by a decrease, which points to a peculiar "dual" role of viscosity in sustaining $\textrm{AI}$ in the CPF, namely, viscosity promotes sustenance of $\textrm{AI}$ at moderate Reynolds numbers but suppresses it at low and high Reynolds numbers. These results can be well understood within the Ginzburg-Landau framework, and therefore can be expected to have a wider applicability.


title: Nonadiabatic dissociation of molecular Bose-Einstein condensates: competition between chemical reactions

abstract: We provide a framework to solve generic models describing the dissociation of multiple molecular Bose-Einstein condensates in a nonadiabatic regime. The competition between individual chemical reactions can lead to non-trivial dependence on critical components such as path interference and symmetries, thus, affecting the final distribution of atomic population. We find an analytical solution for an illustrative example model involving four atomic modes. When the system parameters satisfy $CPT$ symmetry, where $C$ is charge conjugation, $P$ is parity, and $T$ is time-reversal symmetry, our solution predicts a population imbalance between atomic modes that is exponentially sensitive to system parameters. However, a weakly broken symmetry alters the population in each atomic mode and can reverse the population imbalance. Our solution also demonstrates a strong quantum correlation between atomic modes that leads to the spontaneous production of atoms in a multi-mode squeezed state. Moreover, in our framework, a time-dependent non-Hermitian quantum mechanics naturally manifests which can alternatively be realized experimentally in photonic systems.


title: An analysis of citing and referencing habits across all scholarly disciplines: approaches and trends in bibliographic referencing and citing practices

abstract: Purpose. In this study, we want to identify current possible causes for citing and referencing errors in scholarly literature to compare if something changed from the snapshot provided Sweetland in his 1989 paper. Design/methodology/approach. We analysed reference elements, i.e. bibliographic references, mentions, quotations, and respective in-text reference pointers, from 729 articles published in 147 journals across the 27 subject areas. Findings. The outcomes of our analysis pointed out that bibliographic errors have been perpetuated for decades and that their possible causes have increased, despite the encouraged use of technological facilities, i.e., the reference managers. Originality. As far as we know, our study is the best recent available analysis of errors in referencing and citing practices in the literature since Sweetland (1989).


title: Acoustic Event Detection with Classifier Chains

abstract: This paper proposes acoustic event detection (AED) with classifier chains, a new classifier based on the probabilistic chain rule. The proposed AED with classifier chains consists of a gated recurrent unit and performs iterative binary detection of each event one by one. In each iteration, the event's activity is estimated and used to condition the next output based on the probabilistic chain rule to form classifier chains. Therefore, the proposed method can handle the interdependence among events upon classification, while the conventional AED methods with multiple binary classifiers with a linear layer and sigmoid function have placed an assumption of conditional independence. In the experiments with a real-recording dataset, the proposed method demonstrates its superior AED performance to a relative 14.80% improvement compared to a convolutional recurrent neural network baseline system with the multiple binary classifiers.


title: TransCG: A Large-Scale Real-World Dataset for Transparent Object Depth Completion and a Grasping Baseline

abstract: Transparent objects are common in our daily life and frequently handled in the automated production line. Robust vision-based robotic grasping and manipulation for these objects would be beneficial for automation. However, the majority of current grasping algorithms would fail in this case since they heavily rely on the depth image, while ordinary depth sensors usually fail to produce accurate depth information for transparent objects owing to the reflection and refraction of light. In this work, we address this issue by contributing a large-scale real-world dataset for transparent object depth completion, which contains 57,715 RGB-D images from 130 different scenes. Our dataset is the first large-scale, real-world dataset that provides ground truth depth, surface normals, transparent masks in diverse and cluttered scenes. Cross-domain experiments show that our dataset is more general and can enable better generalization ability for models. Moreover, we propose an end-to-end depth completion network, which takes the RGB image and the inaccurate depth map as inputs and outputs a refined depth map. Experiments demonstrate superior efficacy, efficiency and robustness of our method over previous works, and it is able to process images of high resolutions under limited hardware resources. Real robot experiments show that our method can also be applied to novel transparent object grasping robustly. The full dataset and our method are publicly available at www.graspnet.net/transcg


title: Full-Span Log-Linear Model and Fast Learning Algorithm

abstract: The full-span log-linear(FSLL) model introduced in this paper is considered an $n$-th order Boltzmann machine, where $n$ is the number of all variables in the target system. Let $X=(X_0,...,X_{n-1})$ be finite discrete random variables that can take $|X|=|X_0|...|X_{n-1}|$ different values. The FSLL model has $|X|-1$ parameters and can represent arbitrary positive distributions of $X$. The FSLL model is a "highest-order" Boltzmann machine; nevertheless, we can compute the dual parameters of the model distribution, which plays important roles in exponential families, in $O(|X|\log|X|)$ time. Furthermore, using properties of the dual parameters of the FSLL model, we can construct an efficient learning algorithm. The FSLL model is limited to small probabilistic models up to $|X|\approx2^{25}$; however, in this problem domain, the FSLL model flexibly fits various true distributions underlying the training data without any hyperparameter tuning. The experiments presented that the FSLL successfully learned six training datasets such that $|X|=2^{20}$ within one minute with a laptop PC.


title: Constructing Local Bases for a Deep Variational Quantum Eigensolver for Molecular Systems

abstract: Current quantum computers are limited in the number of qubits and coherence time, constraining the algorithms executable with sufficient fidelity. The variational quantum eigensolver (VQE) is an algorithm to find an approximate ground state of a quantum system and is expected to work on even such a device. The deep VQE [K. Fujii, et al., arXiv:2007.10917] is an extension of the original VQE algorithm, which takes a divide-and-conquer approach to relax the hardware requirement. While the deep VQE is successfully applied for spin models and periodic material, its validity on a molecule, where the Hamiltonian is highly nonlocal in the qubit basis, is still unexplored. Here, we discuss the performance of the deep VQE algorithm applied to quantum chemistry problems. Specifically, we examine different subspaceforming methods and compare their accuracy and complexity on a 10 H-atom treelike molecule as well as a 13 H-atom version. Additionally, we examine the performance on the natural occurring molecule retinal. This work also proposes multiple methods to lower the number of qubits required to calculate the ground state of a molecule. We find that the deep VQE can simulate the electron-correlation energy of the ground state to an error of below 1%, thus helping us to reach chemical accuracy in some cases. The accuracy differences and qubits' reduction highlights the basis creation method's impact on the deep VQE.


title: Non-Autoregressive ASR with Self-Conditioned Folded Encoders

abstract: This paper proposes CTC-based non-autoregressive ASR with self-conditioned folded encoders. The proposed method realizes non-autoregressive ASR with fewer parameters by folding the conventional stack of encoders into only two blocks; base encoders and folded encoders. The base encoders convert the input audio features into a neural representation suitable for recognition. This is followed by the folded encoders applied repeatedly for further refinement. Applying the CTC loss to the outputs of all encoders enforces the consistency of the input-output relationship. Thus, folded encoders learn to perform the same operations as an encoder with deeper distinct layers. In experiments, we investigate how to set the number of layers and the number of iterations for the base and folded encoders. The results show that the proposed method achieves a performance comparable to that of the conventional method using only 38% as many parameters. Furthermore, it outperforms the conventional method when increasing the number of iterations.


title: Selected Topics in Analytic Conformal Bootstrap: A Guided Journey

abstract: This review aims to offer a pedagogical introduction to the analytic conformal bootstrap program via a journey through selected topics. We review analytic methods which include the large spin perturbation theory, Mellin space methods and the Lorentzian inversion formula. These techniques are applied to a variety of topics ranging from large-N theories, to the epsilon expansion and holographic superconformal correlators, and are demonstrated in a large number of explicit examples.


title: High Precision QED Initial State Corrections for $e^+ e^- \rightarrow \gamma^*/Z^*$ Annihilation

abstract: The precise knowledge of the QED initial state corrections is of instrumental importance in studying high luminosity measurements in $e^+e^-$ annihilation at facilities like LEP, the International Linear Collider ILC, CLIC, a Giga-$Z$ facility, and the planned FCC\_ee. Logarithmic corrections of up to $O(\alpha^6 L^5)$ are necessary with various subleading terms taken into account. This applies to both the inclusive measurement of processes like $e^+ e^- \rightarrow \gamma^*/Z^*$ and also the forward-backward asymmetry. As has been shown recently, techniques from massive QCD, such as the computation of massive on-shell operator matrix elements, can be used for these calculations. We give an introduction to this topic and present both the calculation methods and the numerical corrections having been reached so far.


title: A Method for Decrypting Data Infected with Hive Ransomware

abstract: Among the many types of malicious codes, ransomware poses a major threat. Ransomware encrypts data and demands a ransom in exchange for decryption. As data recovery is impossible if the encryption key is not obtained, some companies suffer from considerable damage, such as the payment of huge amounts of money or the loss of important data. In this paper, we analyzed Hive ransomware, which appeared in June 2021. Hive ransomware has caused immense harm, leading the FBI to issue an alert about it. To minimize the damage caused by Hive Ransomware and to help victims recover their files, we analyzed Hive Ransomware and studied recovery methods. By analyzing the encryption process of Hive ransomware, we confirmed that vulnerabilities exist by using their own encryption algorithm. We have recovered the master key for generating the file encryption key partially, to enable the decryption of data encrypted by Hive ransomware. We recovered 95% of the master key without the attacker's RSA private key and decrypted the actual infected data. To the best of our knowledge, this is the first successful attempt at decrypting Hive ransomware. It is expected that our method can be used to reduce the damage caused by Hive ransomware.


title: Recurrent X-ray flares of the black hole candidate in the globular cluster RZ 2109 in NGC 4472

abstract: We report on the systematic analysis of the X-ray observations of the ultra-luminous X-ray source XMMU J122939.7+075333 located in the globular cluster RZ 2109 in the Virgo galaxy NGC 4472. The inclusion of observations and time intervals ignored in previous works and the careful selection of extraction regions and energy bands have allowed us to identify new flaring episodes, in addition to the ones that made it one of the best black hole candidates in globular clusters. Although most observations are too short and sparse to recognize a regular pattern, the spacing of the three most recent X-ray flares is compatible with a ~34 hours recurrence time. If confirmed by future observations, such behavior, together with the soft spectrum of the X-ray flares, would be strikingly similar to the quasi-periodic eruptions recently discovered in galactic nuclei. Following one of the possible interpretations of these systems and of a peculiar class of extra-galactic X-ray transients, we explore the possibility that XMMU J122939.7+075333 might be powered by the partial disruption of a white dwarf by an intermediate mass (M~700 Msun) black hole.


title: On the Evaluation Metrics for Paraphrase Generation

abstract: In this paper we revisit automatic metrics for paraphrase evaluation and obtain two findings that disobey conventional wisdom: (1) Reference-free metrics achieve better performance than their reference-based counterparts. (2) Most commonly used metrics do not align well with human annotation. Underlying reasons behind the above findings are explored through additional experiments and in-depth analyses. Based on the experiments and analyses, we propose ParaScore, a new evaluation metric for paraphrase generation. It possesses the merits of reference-based and reference-free metrics and explicitly models lexical divergence. Experimental results demonstrate that ParaScore significantly outperforms existing metrics.


title: Eliciting Structural and Semantic Global Knowledge in Unsupervised Graph Contrastive Learning

abstract: Graph Contrastive Learning (GCL) has recently drawn much research interest for learning generalizable node representations in a self-supervised manner. In general, the contrastive learning process in GCL is performed on top of the representations learned by a graph neural network (GNN) backbone, which transforms and propagates the node contextual information based on its local neighborhoods. However, nodes sharing similar characteristics may not always be geographically close, which poses a great challenge for unsupervised GCL efforts due to their inherent limitations in capturing such global graph knowledge. In this work, we address their inherent limitations by proposing a simple yet effective framework -- Simple Neural Networks with Structural and Semantic Contrastive Learning} (S^3-CL). Notably, by virtue of the proposed structural and semantic contrastive learning algorithms, even a simple neural network can learn expressive node representations that preserve valuable global structural and semantic patterns. Our experiments demonstrate that the node representations learned by S^3-CL achieve superior performance on different downstream tasks compared with the state-of-the-art unsupervised GCL methods. Implementation and more experimental details are publicly available at \url{https://github.com/kaize0409/S-3-CL.}


title: Second-order topological insulator in periodically driven lattice

abstract: The higher-order topological insulator (HOTI) is a new type of topological system which has special bulkedge correspondence compared with conventional topological insulators. In this work, we propose a scheme to realize Floquet HOTI in ultracold atom systems. With the combination of periodically spin-dependent driving of the superlattices and a next-next-nearest-neighbor d-wave-like anisotropic coupling term between different spin components, a Floquet second-order topological insulator with four zero-energy corner states emerges, whose Wannier bands are gapless and exhibit interesting bulk topology. Furthermore, the anisotropic coupling with nearest-neighbor form will also induce some intriguing topological phenomena, e.g. non-topologically protected corner states and topological semimetal for two different types of lattice structures respectively. Our scheme may give insight into the construction of different types of higher-order topological insulators in synthetic systems. It also provides an experimentally feasible platform to research the relations between different types of topological states and may have a wide range of applications in future.


title: Online Scheduling of Time-Critical Tasks to Minimize the Number of Calibrations

abstract: We study the online scheduling problem where the machines need to be calibrated before processing any jobs. To calibrate a machine, it will take $\lambda$ time steps as the activation time, and then the machine will remain calibrated status for $T$ time steps. The job can only be processed by the machine that is in calibrated status. Given a set of jobs arriving online, each of the jobs is characterized by a release time, a processing time, and a deadline. We assume that there is an infinite number of machines for usage. The objective is to minimize the total number of calibrations while feasibly scheduling all jobs. For the case that all jobs have unit processing times, we propose an $\mathcal{O}(\lambda)$-competitive algorithm, which is asymptotically optimal. When $\lambda=0$, the problem is degraded to rent minimization, where our algorithm achieves a competitive ratio of $3e+7(\approx 15.16)$ which improves upon the previous results for such problems.


title: Doping control of magnetic anisotropy for stable antiskyrmion formation in schreibersite (Fe,Ni)$_3$P with $S_4$ symmetry

abstract: Magnetic skyrmions, vortex-like topological spin textures, have attracted much interest in a wide range of research fields from fundamental physics to spintronics applications. Recently, growing attention has also been paid to antiskyrmions emerging in opposite topological charge in non-centrosymmetric magnets with $D_{2\mathrm{d}}$ or $S_4$ symmetry. In these magnets, complex interplay among anisotropic Dzyaloshinskii-Moriya interaction, uniaxial magnetic anisotropy, and magnetic dipolar interactions generates a variety of magnetic structures. However, the relation between the stability of antiskyrmions and these magnetic interactions remains to be elucidated. In this work, we control the uniaxial magnetic anisotropy of schreibersite (Fe,Ni)$_3$P with $S_4$ symmetry by doping and investigate its impact on the stability of antiskyrmions. Our magnetometry study, supported by ferromagnetic resonance spectroscopy, shows that the variation of the Ni content and slight doping with 4$d$ transition metals considerably change the magnetic anisotropy. In particular, doping with Pd induces easy-axis anisotropy, giving rise to formation of antiskyrmions, while a temperature-induced spin reorientation is observed in a Rh-doped compound. In combination with Lorentz transmission electron microscopy and micromagnetic simulations, we quantitatively analyze the stability of antiskyrmion as functions of uniaxial anisotropy and demagnetization energy, and demonstrate that subtle balance between them is necessary to stabilize the antiskyrmions.


title: Interior ideal in regular and intra regular semigroup

abstract: Following G.Szasz [2] a subsemigroup I of semigroup S is called an interior ideal if SIS \subset I. In this paper we explore the classes of regular semigroup and its different subclasses by their interior ideals. Furthermore, we introduce the strongly prime, prime, semiprime, strongly irreducible, and irreducible interior ideals of semigroups and also characterize those semigroups for which each interior ideal is strongly prime. Some important interplay between the classes of all interior ideals and other ideals are given here. In addition to this, we present different characterizations of semigroups by their minimal interior ideals.


title: Multi-Objective Model Selection for Time Series Forecasting

abstract: Research on time series forecasting has predominantly focused on developing methods that improve accuracy. However, other criteria such as training time or latency are critical in many real-world applications. We therefore address the question of how to choose an appropriate forecasting model for a given dataset among the plethora of available forecasting methods when accuracy is only one of many criteria. For this, our contributions are two-fold. First, we present a comprehensive benchmark, evaluating 7 classical and 6 deep learning forecasting methods on 44 heterogeneous, publicly available datasets. The benchmark code is open-sourced along with evaluations and forecasts for all methods. These evaluations enable us to answer open questions such as the amount of data required for deep learning models to outperform classical ones. Second, we leverage the benchmark evaluations to learn good defaults that consider multiple objectives such as accuracy and latency. By learning a mapping from forecasting models to performance metrics, we show that our method PARETOSELECT is able to accurately select models from the Pareto front -- alleviating the need to train or evaluate many forecasting models for model selection. To the best of our knowledge, PARETOSELECT constitutes the first method to learn default models in a multi-objective setting.


title: Energy-Efficient UAV Communications: A Generalised Propulsion Energy Consumption Model

abstract: This paper proposes a generalised propulsion energy consumption model (PECM) for rotary-wing ummanned aerial vehicles (UAVs) under the consideration of the practical thrust-to-weight ratio (TWR) with respect to the velocity, acceleration and direction change of the UAVs. To verify the effectiveness of the proposed PECM, we consider a UAV-enabled communication system, where a rotary-wing UAV serves multiple ground users as an aerial base station. We aim to maximize the energy efficiency (EE) of the UAV by jointly optimizing the user scheduling and UAV trajectory variables. However, the formulated problem is a non-convex fractional integer programming problem, which is challenging to obtain its optimal solution. To tackle this, we propose an efficient iterative algorithm by decomposing the original problem into two sub-problems to obtain a suboptimal solution based on the successive convex approximation technique. Simulation results show that the optimized UAV trajectory by applying the proposed PECM are smoother and the corresponding EE has significant improvement as compared to other benchmark schemes.


title: LiDAR-Inertial 3D SLAM with Plane Constraint for Multi-story Building

abstract: The ubiquitous planes and structural consistency are the most apparent features of indoor multi-story Buildings compared with outdoor environments. In this paper, we propose a tightly coupled LiDAR-Inertial 3D SLAM framework with plane features for the multi-story building. The framework we proposed is mainly composed of three parts: tightly coupled LiDAR-Inertial odometry, extraction of representative planes of the structure, and factor graph optimization. By building a local map and inertial measurement unit (IMU) pre-integration, we get LiDAR scan-to-local-map matching and IMU measurements, respectively. Minimize the joint cost function to obtain the LiDAR-Inertial odometry information. Once a new keyframe is added to the graph, all the planes of this keyframe that can represent structural features are extracted to find the constraint between different poses and stories. A keyframe-based factor graph is conducted with the constraint of planes, and LiDAR-Inertial odometry for keyframe poses refinement. The experimental results show that our algorithm has outstanding performance in accuracy compared with the state-of-the-art algorithms.


title: Adaptive Model Refinement Approach for Bayesian Uncertainty Quantification in Turbulence Model

abstract: The Bayesian uncertainty quantification technique has become well established in turbulence modeling over the past few years. However, it is computationally expensive to construct a globally accurate surrogate model for Bayesian inference in a high-dimensional design space, which limits uncertainty quantification for complex flow configurations. Borrowing ideas from stratified sampling and inherited sampling, an adaptive model refinement approach is proposed in this work, which concentrates on asymptotically improving the local accuracy of the surrogate model in the high-posterior-density region by adaptively appending model evaluation points. To achieve this goal, a modification of inherited Latin hypercube sampling is proposed and then integrated into the Bayesian framework. The effectiveness and efficiency of the proposed approach are demonstrated through a two-dimensional heat source inversion problem and its extension to a high-dimensional design space. Compared with the prior-based method, the adaptive model refinement approach has the ability to obtain more reliable inference results using fewer evaluation points. Finally, the approach is applied to parametric uncertainty quantification of the Menter shear-stress transport turbulence model for an axisymmetric transonic bump flow and provides convincing numerical results.


title: A Faster Interior-Point Method for Sum-of-Squares Optimization

abstract: We present a faster interior-point method for optimizing sum-of-squares (SOS) polynomials, which are a central tool in polynomial optimization and capture convex programming in the Lasserre hierarchy. Let $p = \sum_i q^2_i$ be an $n$-variate SOS polynomial of degree $2d$. Denoting by $L := \binom{n+d}{d}$ and $U := \binom{n+2d}{2d}$ the dimensions of the vector spaces in which $q_i$'s and $p$ live respectively, our algorithm runs in time $\tilde{O}(LU^{1.87})$. This is polynomially faster than state-of-art SOS and semidefinite programming solvers, which achieve runtime $\tilde{O}(L^{0.5}\min\{U^{2.37}, L^{4.24}\})$. The centerpiece of our algorithm is a dynamic data structure for maintaining the inverse of the Hessian of the SOS barrier function under the polynomial interpolant basis, which efficiently extends to multivariate SOS optimization, and requires maintaining spectral approximations to low-rank perturbations of elementwise (Hadamard) products. This is the main challenge and departure from recent IPM breakthroughs using inverse-maintenance, where low-rank updates to the slack matrix readily imply the same for the Hessian matrix.


title: Dynamic Object Comprehension: A Framework For Evaluating Artificial Visual Perception

abstract: Augmented and Mixed Reality are emerging as likely successors to the mobile internet. However, many technical challenges remain. One of the key requirements of these systems is the ability to create a continuity between physical and virtual worlds, with the user's visual perception as the primary interface medium. Building this continuity requires the system to develop a visual understanding of the physical world. While there has been significant recent progress in computer vision and AI techniques such as image classification and object detection, success in these areas has not yet led to the visual perception required for these critical MR and AR applications. A significant issue is that current evaluation criteria are insufficient for these applications. To motivate and evaluate progress in this emerging area, there is a need for new metrics. In this paper we outline limitations of current evaluation criteria and propose new criteria.


title: A Three-component Model for Cosmic-ray Spectrum and Dipole Anisotropy

abstract: Using a three-component, multi-scale diffusion model, we show that the cosmic-ray (CR) proton and helium spectra and the dipole anisotropy can be explained with reasonable parameters. The model includes a nearby source associated with the supernova remnant (SNR) that gave rise to the Geminga pulsar, a source at the Galactic center, and a component associated with the Galactic disk. The CR flux below TeV is dominated by the disk component. The center source with a continuous injection of CRs starting about 18 Myr ago is needed to explain the anisotropy above 100 TeV. With the assumption of universal CR spectra injected by all SNRs, the nearby source can produce a TeV spectral bump observed at Earth via slow diffusion across the interstellar magnetic field, which needs to have an angle $ \theta \approx 5^{\circ} $ between the field line and the line of sight toward the source, and have weak magnetic turbulence with the Alfv\'{e}n Mach number $ M_{\text{A}}\approx 0.1 $. Considering the modulation of the Galactic-scale anisotropy by this magnetic field, in a quasi-local approach the field may be directed at a right ascension about $ -90^{\circ} $ and a declination about $ -7.4^{\circ} $ in the equatorial coordinate system.


title: Feels Bad Man: Dissecting Automated Hateful Meme Detection Through the Lens of Facebook's Challenge

abstract: Internet memes have become a dominant method of communication; at the same time, however, they are also increasingly being used to advocate extremism and foster derogatory beliefs. Nonetheless, we do not have a firm understanding as to which perceptual aspects of memes cause this phenomenon. In this work, we assess the efficacy of current state-of-the-art multimodal machine learning models toward hateful meme detection, and in particular with respect to their generalizability across platforms. We use two benchmark datasets comprising 12,140 and 10,567 images from 4chan's "Politically Incorrect" board (/pol/) and Facebook's Hateful Memes Challenge dataset to train the competition's top-ranking machine learning models for the discovery of the most prominent features that distinguish viral hateful memes from benign ones. We conduct three experiments to determine the importance of multimodality on classification performance, the influential capacity of fringe Web communities on mainstream social platforms and vice versa, and the models' learning transferability on 4chan memes. Our experiments show that memes' image characteristics provide a greater wealth of information than its textual content. We also find that current systems developed for online detection of hate speech in memes necessitate further concentration on its visual elements to improve their interpretation of underlying cultural connotations, implying that multimodal models fail to adequately grasp the intricacies of hate speech in memes and generalize across social media platforms.


title: Half-Quantized Hall Effect and Power Law Decay of Edge Current Distribution

abstract: The half-quantized Hall conductance is characteristic of quantum systems with parity anomaly. Here we investigate topological and transport properties of a class of parity anomalous semimetals, in which massive Dirac fermions coexist with massless Dirac fermions in momentum space or real space, and uncovered a distinct bulk-edge correspondence that the half-quantized Hall effect is realized via the bulk massless Dirac fermions while the nontrivial Berry curvature is provided by the massive Dirac fermions. The spatial distribution of the edge current decays away from the boundary in a power law instead of an exponential law in integer quantum Hall effect. We further address physical relevance of parity anomalous semimetal to three-dimensional semi-magnetic topological insulators and two-dimensional photonic crystals.


title: Learning continuous models for continuous physics

abstract: Dynamical systems that evolve continuously over time are ubiquitous throughout science and engineering. Machine learning (ML) provides data-driven approaches to model and predict the dynamics of such systems. A core issue with this approach is that ML models are typically trained on discrete data, using ML methodologies that are not aware of underlying continuity properties. This results in models that often do not capture any underlying continuous dynamics -- either of the system of interest, or indeed of any related system. To address this challenge, we develop a convergence test based on numerical analysis theory. Our test verifies whether a model has learned a function that accurately approximates an underlying continuous dynamics. Models that fail this test fail to capture relevant dynamics, rendering them of limited utility for many scientific prediction tasks; while models that pass this test enable both better interpolation and better extrapolation in multiple ways. Our results illustrate how principled numerical analysis methods can be coupled with existing ML training/testing methodologies to validate models for science and engineering applications.


title: Predict the Rover Mobility over Soft Terrain using Articulated Wheeled Bevameter

abstract: Robot mobility is critical for mission success, especially in soft or deformable terrains, where the complex wheel-soil interaction mechanics often leads to excessive wheel slip and sinkage, causing the eventual mission failure. To improve the success rate, online mobility prediction using vision, infrared imaging, or model-based stochastic methods have been used in the literature. This paper proposes an on-board mobility prediction approach using an articulated wheeled bevameter that consists of a force-controlled arm and an instrumented bevameter (with force and vision sensors) as its end-effector. The proposed bevameter, which emulates the traditional terramechanics tests such as pressure-sinkage and shear experiments, can measure contact parameters ahead of the rover's body in real-time, and predict the slip and sinkage of supporting wheels over the probed region. Based on the predicted mobility, the rover can select a safer path in order to avoid dangerous regions such as those covered with quicksand. Compared to the literature, our proposed method can avoid the complicated terramechanics modeling and time-consuming stochastic prediction; it can also mitigate the inaccuracy issues arising in non-contact vision-based methods. We also conduct multiple experiments to validate the proposed approach.


title: A fine-grained, versatile index of remoteness to characterize place-level rurality

abstract: Rural-urban classifications are essential for analyzing geographic, demographic, environmental, or socioeconomic processes across the rural-urban continuum. However, existing county-level classifications may ignore the within-county variations of rurality, which can be problematic if the scale of interest is at the place-level or finer. Moreover, existing rural-urban classification are often inconsistent over time and thus, impede the long-term analysis of rural-urban dynamics. We developed a distance-based method to generate place-level remoteness estimates based on simple input data. We create our remoteness index based on place-level population data for the U.S. from 1980 to 2010. The proposed index is generalizable to data-scarce environments and earlier time periods and is based on the distances of a given place to the nearest places of different population sizes, and allows for fine-grained, temporally consistent analyses of rural-urban processes.


title: The Development and Prospect of Code Clone

abstract: The application of code clone technology accelerates code search, improves code reuse efficiency, and assists in software quality assessment and code vulnerability detection. However, the application of code clones also introduces software quality issues and increases the cost of software maintenance. As an important research field in software engineering, code clone has been extensively explored and studied by researchers, and related studies on various sub-research fields have emerged, including code clone detection, code clone evolution, code clone analysis, etc. However, there lacks a comprehensive exploration of the entire field of code clone, as well as an analysis of the trend of each sub-research field. This paper collects related work of code clones in the past ten years. In summary, the contributions of this paper mainly include: (1) summarize and classify the sub-research fields of code clone, and explore the relative popularity and relation of these sub-research fields; (2) analyze the overall research trend of code clone and each sub-research field; (3) compare and analyze the difference between academy and industry regarding code clone research; (4) construct a network of researchers, and excavate the major contributors in code clone research field; (5) The list of popular conferences and journals was statistically analyzed. The popular research directions in the future include clone visualization, clone management, etc. For the clone detection technique, researchers can optimize the scalability and execution efficiency of the method, targeting particular clone detection tasks and contextual environments, or apply the technology to other related research fields continuously.


title: Mirror-Yolo: An attention-based instance segmentation and detection model for mirrors

abstract: Mirrors can degrade the performance of computer vision models, however to accurately detect mirrors in images remains challenging. YOLOv4 achieves phenomenal results both in object detection accuracy and speed, nevertheless the model often fails in detecting mirrors. In this paper, a novel mirror detection method `Mirror-YOLO' is proposed, which mainly targets on mirror detection. Based on YOLOv4, the proposed model embeds an attention mechanism for better feature acquisition, and a hypercolumn-stairstep approach for feature map fusion. Mirror-YOLO can also produce accurate bounding polygons for instance segmentation. The effectiveness of our proposed model is demonstrated by our experiments, compared to the existing mirror detection methods, the proposed Mirror-YOLO achieves better performance in detection accuracy on the mirror image dataset.


title: The Complexity of SPEs in Mean-payoff Games

abstract: We establish that the subgame perfect equilibrium (SPE) threshold problem for mean-payoff games is NP-complete. While the SPE threshold problem was recently shown to be decidable (in doubly exponential time) and NP-hard, its exact worst case complexity was left open.


title: Causal inference with recurrent and competing events

abstract: Many research questions concern treatment effects on outcomes that can recur several times in the same individual. For example, medical researchers are interested in treatment effects on hospitalizations in heart failure patients and sports injuries in athletes. Competing events, such as death, complicate causal inference in studies of recurrent events because once a competing event occurs, an individual cannot have more recurrent events. Several statistical estimands have been studied in recurrent event settings, with and without competing events. However, the causal interpretations of these estimands, and the conditions that are required to identify these estimands from observed data, have yet to be formalized. Here we use a counterfactual framework for causal inference to formulate several causal estimands in recurrent event settings, with and without competing events. When competing events exist, we clarify when commonly used classical statistical estimands can be interpreted as causal quantities from the causal mediation literature, such as (controlled) direct effects and total effects. Furthermore, we show that recent results on interventionist mediation estimands allow us to define new causal estimands with recurrent and competing events that may be of particular clinical relevance in many subject matter settings. We use causal directed acyclic graphs and single world intervention graphs to illustrate how to reason about identification conditions for the various causal estimands using subject matter knowledge. Furthermore, using results on counting processes, we show how our causal estimands and their identification conditions, which are articulated in discrete time, converge to classical continuous-time counterparts in the limit of fine discretizations of time. Finally, we propose several estimators and establish their consistency for the various identifying functionals.


title: Tracking the Mn diffusion in the carbon-supported nanoparticles through the collaborative analysis of atom probe and evaporation simulation

abstract: Carbon-supported nanoparticles have been used widely as efficient catalysts due to their enhanced surface-to-volume ratio. To investigate their structure-property relationships, acquiring 3D elemental distribution is highly required. Here, the carbon-supported Pt, PtMn alloy, and ordered Pt3Mn nanoparticles are synthesized and analyzed with atom probe tomography as model systems. The significant difference of Mn distribution after the heat-treatment was found. Finally, the field evaporation behavior of the carbon support was discussed and each acquired reconstruction was compared with computational results from the evaporation simulation. This paper provides a guideline for studies using atom probe tomography on the heterogeneous carbon-nanoparticle system that leads to insights toward to a wide application in carbon-supported nano-catalysts.


title: CLS: Cross Labeling Supervision for Semi-Supervised Learning

abstract: It is well known that the success of deep neural networks is greatly attributed to large-scale labeled datasets. However, it can be extremely time-consuming and laborious to collect sufficient high-quality labeled data in most practical applications. Semi-supervised learning (SSL) provides an effective solution to reduce the cost of labeling by simultaneously leveraging both labeled and unlabeled data. In this work, we present Cross Labeling Supervision (CLS), a framework that generalizes the typical pseudo-labeling process. Based on FixMatch, where a pseudo label is generated from a weakly-augmented sample to teach the prediction on a strong augmentation of the same input sample, CLS allows the creation of both pseudo and complementary labels to support both positive and negative learning. To mitigate the confirmation bias of self-labeling and boost the tolerance to false labels, two different initialized networks with the same structure are trained simultaneously. Each network utilizes high-confidence labels from the other network as additional supervision signals. During the label generation phase, adaptive sample weights are assigned to artificial labels according to their prediction confidence. The sample weight plays two roles: quantify the generated labels' quality and reduce the disruption of inaccurate labels on network training. Experimental results on the semi-supervised classification task show that our framework outperforms existing approaches by large margins on the CIFAR-10 and CIFAR-100 datasets.


title: Early exclusion leads to cyclical cooperation in repeated group interactions

abstract: Explaining the emergence and maintenance of cooperation among selfish individuals from an evolutionary perspective remains a grand challenge in biology, economy, and social sciences. Social exclusion is believed to be an answer to this conundrum. However, previously related studies often assume one-shot interactions and ignore how free-riding is identified, which seem to be too idealistic. In this work, we consider repeated interactions where excluders need to pay a monitoring cost to identify free-riders for exclusion and free-riders cannot participate in the following possible game interactions once they are identified and excluded by excluders in the repeated interaction process. We reveal that the introduction of such exclusion can prevent the breakdown of cooperation in repeated group interactions. In particular, we demonstrate that an evolutionary oscillation among cooperators, defectors, and excluders can appear in infinitely large populations when early exclusion is implemented. In addition, we find that the population spends most of the time in states where cooperators dominate for early exclusion when stochastic mutation-selection is considered in finite populations. Our results highlight that early exclusion is successful in solving the mentioned enigma of cooperation in repeated group interactions.


title: Finding Representative Sampling Subsets in Sensor Graphs using Time Series Similarities

abstract: With the increasing use of IoT-enabled sensors, it is important to have effective methods for querying the sensors. For example, in a dense network of battery-driven temperature sensors, it is often possible to query (sample) just a subset of the sensors at any given time, since the values of the non-sampled sensors can be estimated from the sampled values. If we can divide the set of sensors into disjoint so-called representative sampling subsets that each represent the other sensors sufficiently well, we can alternate the sampling between the sampling subsets and thus, increase battery life significantly. In this paper, we formulate the problem of finding representative sampling subsets as a graph problem on a so-called sensor graph with the sensors as nodes. Our proposed solution, SubGraphSample, consists of two phases. In Phase-I, we create edges in the sensor graph based on the similarities between the time series of sensor values, analyzing six different techniques based on proven time series similarity metrics. In Phase-II, we propose two new techniques and extend four existing ones to find the maximal number of representative sampling subsets. Finally, we propose AutoSubGraphSample which auto-selects the best technique for Phase-I and Phase-II for a given dataset. Our extensive experimental evaluation shows that our approach can yield significant battery life improvements within realistic error bounds.


title: Schedule-based Analysis of Transmission Risk in Public Transportation Systems

abstract: Airborne diseases, including COVID-19, raise the question of transmission risk in public transportation systems. However, quantitative analysis of the effectiveness of transmission risk mitigation methods in public transportation is lacking. The paper develops a transmission risk modeling framework based on the Wells-Riley model using as inputs transit operating characteristics, schedule, Origin-Destination (OD) demand, and virus characteristics. The model is sensitive to various factors that operators can control, as well as external factors that may be subject of broader policy decisions (e.g. mask wearing). The model is utilized to assess transmission risk as a function of OD flows, planned operations, and factors such as mask-wearing, ventilation, and infection rates. Using actual data from the Massachusetts Bay Transportation Authority (MBTA) Red Line, the paper explores the transmission risk under different infection rate scenarios, both in magnitude and spatial characteristics. The paper assesses the combined impact from viral load related factors and passenger load factors. Increasing frequency can mitigate transmission risk, but cannot fully compensate for increases in infection rates. Imbalanced passenger distribution on different cars of a train is shown to increase the overall system-wide infection probability. Spatial infection rate patterns should also be taken into account during policymaking as it is shown to impact transmission risk. For lines with branches, demand distribution among the branches is important and headway allocation adjustment among branches to balance the load on trains to different branches can help reduce risk.

categories: cs.SI cs.SY eess.SY physics.soc-ph stat.AP


title: CSCNet: Contextual Semantic Consistency Network for Trajectory Prediction in Crowded Spaces

abstract: Trajectory prediction aims to predict the movement trend of the agents like pedestrians, bikers, vehicles. It is helpful to analyze and understand human activities in crowded spaces and widely applied in many areas such as surveillance video analysis and autonomous driving systems. Thanks to the success of deep learning, trajectory prediction has made significant progress. The current methods are dedicated to studying the agents' future trajectories under the social interaction and the sceneries' physical constraints. Moreover, how to deal with these factors still catches researchers' attention. However, they ignore the \textbf{Semantic Shift Phenomenon} when modeling these interactions in various prediction sceneries. There exist several kinds of semantic deviations inner or between social and physical interactions, which we call the "\textbf{Gap}". In this paper, we propose a \textbf{C}ontextual \textbf{S}emantic \textbf{C}onsistency \textbf{Net}work (\textbf{CSCNet}) to predict agents' future activities with powerful and efficient context constraints. We utilize a well-designed context-aware transfer to obtain the intermediate representations from the scene images and trajectories. Then we eliminate the differences between social and physical interactions by aligning activity semantics and scene semantics to cross the Gap. Experiments demonstrate that CSCNet performs better than most of the current methods quantitatively and qualitatively.


title: Soliton asymptotics for the KdV shock problem of low regularity

abstract: We revisit the asymptotic analysis of the KdV shock problem in the soliton region. Our approach is based on the analysis of the associated Riemann-Hilbert problem and we extend the domain of validity of the asymptotic formulas while at the same time requiring less decay and smoothness for the initial data.


title: Dirac dark matter, dark radiation, and the type-II seesaw mechanism in alternative $U(1)_X$ standard model

abstract: We propose an extra $U(1)_X$ model with an alternative charge assignment for right-handed right-handed neutrinos. The type-II seesaw mechanism by a triplet Higgs field is promising for neutrino mass generation because of the alternative charge assignment. The small vacuum expectation value (VEV) of an additional Higgs doublet naturally leads to a very small VEV of the triplet Higgs field, and as a result, the smallness of neutrino mass can be understood. With the minimal Higgs field for $U(1)_X$ with the charge $1$, right-handed neutrinos are candidates for Dirac dark matter (DM) and dark radiation (DR). We have derived and imposed the LHC bound, the DR constraint and the bound from DM direct searches in the wide range of parameter space. Among various $U(1)_X$ choices, the DM direct search bound is found to be weakest for $U(1)_R$ where the constraints from thermal DM and non-negligible DR can be compatible. Such a number of the effective neutrino species would be interesting from the viewpoint of the so-called Hubble tension.


title: A Study of Designing Compact Audio-Visual Wake Word Spotting System Based on Iterative Fine-Tuning in Neural Network Pruning

abstract: Audio-only-based wake word spotting (WWS) is challenging under noisy conditions due to environmental interference in signal transmission. In this paper, we investigate on designing a compact audio-visual WWS system by utilizing visual information to alleviate the degradation. Specifically, in order to use visual information, we first encode the detected lips to fixed-size vectors with MobileNet and concatenate them with acoustic features followed by the fusion network for WWS. However, the audio-visual model based on neural networks requires a large footprint and a high computational complexity. To meet the application requirements, we introduce a neural network pruning strategy via the lottery ticket hypothesis in an iterative fine-tuning manner (LTH-IF), to the single-modal and multi-modal models, respectively. Tested on our in-house corpus for audio-visual WWS in a home TV scene, the proposed audio-visual system achieves significant performance improvements over the single-modality (audio-only or video-only) system under different noisy conditions. Moreover, LTH-IF pruning can largely reduce the network parameters and computations with no degradation of WWS performance, leading to a potential product solution for the TV wake-up scenario.


title: Multi-Scale Hybrid Vision Transformer for Learning Gastric Histology: AI-Based Decision Support System for Gastric Cancer Treatment

abstract: Gastric endoscopic screening is an effective way to decide appropriate gastric cancer (GC) treatment at an early stage, reducing GC-associated mortality rate. Although artificial intelligence (AI) has brought a great promise to assist pathologist to screen digitalized whole slide images, existing AI systems are limited in fine-grained cancer subclassifications and have little usability in planning cancer treatment. We propose a practical AI system that enables five subclassifications of GC pathology, which can be directly matched to general GC treatment guidance. The AI system is designed to efficiently differentiate multi-classes of GC through multi-scale self-attention mechanism using 2-stage hybrid Vision Transformer (ViT) networks, by mimicking the way how human pathologists understand histology. The AI system demonstrates reliable diagnostic performance by achieving class-average sensitivity of above 0.85 on a total of 1,212 slides from multicentric cohort. Furthermore, AI-assisted pathologists show significantly improved diagnostic sensitivity by 12% in addition to 18% reduced screening time compared to human pathologists. Our results demonstrate that AI-assisted gastric endoscopic screening has a great potential for providing presumptive pathologic opinion and appropriate cancer treatment of gastric cancer in practical clinical settings.


title: Scheduling Complexity of Interleaving Search

abstract: miniKanren is a lightweight embedded language for logic and relational programming. Many of its useful features come from a distinctive search strategy, called interleaving search. However, with interleaving search conventional ways of reasoning about the complexity and performance of logical programs become irrelevant. We identify an important key component -- scheduling -- which makes the reasoning for miniKanren so different, and present a semi-automatic technique to estimate the scheduling impact via symbolic execution for a reasonably wide class of programs.