title: AI in Osteoporosis

abstract: In this chapter we explore and evaluate methods for trabecular bone characterization and osteoporosis diagnosis with increased interest in sparse approximations. We first describe texture representation and classification techniques, patch-based methods such as Bag of Keypoints, and more recent deep neural networks. Then we introduce the concept of sparse representations for pattern recognition and we detail integrative sparse analysis methods and classifier decision fusion methods. We report cross-validation results on osteoporosis datasets of bone radiographs and compare the results produced by the different categories of methods. We conclude that advances in the AI and machine learning fields have enabled the development of methods that can be used as diagnostic tools in clinical settings.


title: De Jonqui\`eres transformations in arbitrary dimension. An ideal theoretic view

abstract: A generalization of the plane de Jonqui\`eres transformation to arbitrary dimension is studied, with an eye for the ideal theoretic side. In particular, one considers structural properties of the corresponding base ideal and of its defining relations. Useful throughout is the idea of downgraded sequences of forms, a tool considered in many sources for the rounding-up of ideals of defining relations. The emphasis here is on the case where the supporting Cremona transformation of the de Jonqui\`eres transformation is the identity map. In this case we establish aspects of the homological behavior of the graph of the transformation.


title: DialogueBERT: A Self-Supervised Learning based Dialogue Pre-training Encoder

abstract: With the rapid development of artificial intelligence, conversational bots have became prevalent in mainstream E-commerce platforms, which can provide convenient customer service timely. To satisfy the user, the conversational bots need to understand the user's intention, detect the user's emotion, and extract the key entities from the conversational utterances. However, understanding dialogues is regarded as a very challenging task. Different from common language understanding, utterances in dialogues appear alternately from different roles and are usually organized as hierarchical structures. To facilitate the understanding of dialogues, in this paper, we propose a novel contextual dialogue encoder (i.e. DialogueBERT) based on the popular pre-trained language model BERT. Five self-supervised learning pre-training tasks are devised for learning the particularity of dialouge utterances. Four different input embeddings are integrated to catch the relationship between utterances, including turn embedding, role embedding, token embedding and position embedding. DialogueBERT was pre-trained with 70 million dialogues in real scenario, and then fine-tuned in three different downstream dialogue understanding tasks. Experimental results show that DialogueBERT achieves exciting results with 88.63% accuracy for intent recognition, 94.25% accuracy for emotion recognition and 97.04% F1 score for named entity recognition, which outperforms several strong baselines by a large margin.


title: Sparse Uniformity Testing

abstract: In this paper we consider the uniformity testing problem for high-dimensional discrete distributions (multinomials) under sparse alternatives. More precisely, we derive sharp detection thresholds for testing, based on $n$ samples, whether a discrete distribution supported on $d$ elements differs from the uniform distribution only in $s$ (out of the $d$) coordinates and is $\varepsilon$-far (in total variation distance) from uniformity. Our results reveal various interesting phase transitions which depend on the interplay of the sample size $n$ and the signal strength $\varepsilon$ with the dimension $d$ and the sparsity level $s$. For instance, if the sample size is less than a threshold (which depends on $d$ and $s$), then all tests are asymptotically powerless, irrespective of the magnitude of the signal strength. On the other hand, if the sample size is above the threshold, then the detection boundary undergoes a further phase transition depending on the signal strength. Here, a $\chi^2$-type test attains the detection boundary in the dense regime, whereas in the sparse regime a Bonferroni correction of two maximum-type tests and a version of the Higher Criticism test is optimal up to sharp constants. These results combined provide a complete description of the phase diagram for the sparse uniformity testing problem across all regimes of the parameters $n$, $d$, and $s$. One of the challenges in dealing with multinomials is that the parameters are always constrained to lie in the simplex. This results in the aforementioned two-layered phase transition, a new phenomenon which does not arise in classical high-dimensional sparse testing problems.


title: On the comparison between jump processes and subordinated diffusions

abstract: Given a symmetric diffusion process and a jump process on the same underlying space, is there a subordinator such that the jump process and the subordinated diffusion processes are comparable? We address this question when the diffusion satisfies a sub-Gaussian heat kernel estimate and the jump process satisfies a polynomial-type jump kernel bounds. Under these assumptions, we obtain necessary and sufficient conditions on the jump kernel estimate for such a subordinator to exist. As an application of our results and the recent stability results of Chen, Kumagai, and Wang, we obtain parabolic Harnack inequality for a large family of jump processes. In particular, we show that any jump process with polynomial-type jump kernel bounds on such a space satisfies the parabolic Harnack inequality.


title: Factorial Schur and Grothendieck polynomials from Bott Samelson varieties

abstract: We use Bott-Samelson resolutions of Schubert varieties in Grassmannians along with equiariant localization techniques to show that the factorial Schur functions and the factorial Grothendieck polynomials represent Schubert classes in equivariant cohomology and equivariant K-theory respectively.


title: Generalized Fractional Repetition Codes for Binary Coded Computations

abstract: This paper addresses the gradient coding and coded matrix multiplication problems in distributed optimization and coded computing. We present a numerically stable binary coding method which overcomes the drawbacks of the \textit{Fractional Repetition Coding} gradient coding method proposed by Tandon et al., and can also be leveraged by coded computing networks whose servers are of heterogeneous nature. Specifically, we propose a construction for fractional repetition gradient coding; while ensuring that the generator matrix remains close to perfectly balanced for any set of coded parameters, as well as a low complexity decoding step. The proposed binary encoding avoids operations over the real and complex numbers which are inherently numerically unstable, thereby enabling numerically stable distributed encodings of the partial gradients. We then make connections between gradient coding and coded matrix multiplication. Specifically, we show that any gradient coding scheme can be extended to coded matrix multiplication. Furthermore, we show how the proposed binary gradient coding scheme can be used to construct two different coded matrix multiplication schemes, each achieving different trade-offs.


title: The NiuTrans Machine Translation Systems for WMT21

abstract: This paper describes NiuTrans neural machine translation systems of the WMT 2021 news translation tasks. We made submissions to 9 language directions, including English$\leftrightarrow$$\{$Chinese, Japanese, Russian, Icelandic$\}$ and English$\rightarrow$Hausa tasks. Our primary systems are built on several effective variants of Transformer, e.g., Transformer-DLCL, ODE-Transformer. We also utilize back-translation, knowledge distillation, post-ensemble, and iterative fine-tuning techniques to enhance the model performance further.


title: Estimating Gibbs partition function with quantumClifford sampling

abstract: The partition function is an essential quantity in statistical mechanics, and its accurate computation is a key component of any statistical analysis of quantum system and phenomenon. However, for interacting many-body quantum systems, its calculation generally involves summing over an exponential number of terms and can thus quickly grow to be intractable. Accurately and efficiently estimating the partition function of its corresponding system Hamiltonian then becomes the key in solving quantum many-body problems. In this paper we develop a hybrid quantum-classical algorithm to estimate the partition function, utilising a novel Clifford sampling technique. Note that previous works on quantum estimation of partition functions require $\mathcal{O}(1/\epsilon\sqrt{\Delta})$-depth quantum circuits~\cite{Arunachalam2020Gibbs, Ashley2015Gibbs}, where $\Delta$ is the minimum spectral gap of stochastic matrices and $\epsilon$ is the multiplicative error. Our algorithm requires only a shallow $\mathcal{O}(1)$-depth quantum circuit, repeated $\mathcal{O}(1/\epsilon^2)$ times, to provide a comparable $\epsilon$ approximation. Shallow-depth quantum circuits are considered vitally important for currently available NISQ (Noisy Intermediate-Scale Quantum) devices.


title: Sharpened dynamics alternative and its $C^1$-robustness for strongly monotone discrete dynamical systems

abstract: For strongly monotone dynamical systems, the dynamics alternative for smooth discrete-time systems turns out to be a perfect analogy of the celebrated Hirsch's limit-set dichotomy for continuous-time semiflows. In this paper, we first present a sharpened dynamics alternative for $C^1$-smooth strongly monotone discrete-time dissipative system $\{F_0^n\}_{n\in \mathbb{N}}$ (with an attractor $A$), which concludes that there is a positive integer $m$ such that any orbit is either manifestly unstable; or asymptotic to a linearly stable cycle whose minimal period is bounded by $m$. Furthermore, we show the $C^1$-robustness of the sharpened dynamics alternative, that is, for any $C^1$-perturbed system $\{F_\epsilon^n\}_{n\in \mathbb{N}}$ ($F_\epsilon$ not necessarily monotone), any orbit initiated nearby $A$ will admit the sharpened dynamics alternative with the same $m$. The improved generic convergence to cycles for the $C^1$-system $\{F_0^n\}_{n\in \mathbb{N}}$, as well as for the perturbed system $\{F_\epsilon^n\}_{n\in \mathbb{N}}$, is thus obtained as by-products of the sharpened dynamics alternative and its $C^1$-robustness. The results are applied to nonlocal $C^1$-perturbations of a time-periodic parabolic equations and give typical convergence to periodic solutions whose minimal periods are uniformly bounded.


title: A Model-free Deep Reinforcement Learning Approach To Maneuver A Quadrotor Despite Single Rotor Failure

abstract: Ability to recover from faults and continue mission is desirable for many quadrotor applications. The quadrotor's rotor may fail while performing a mission and it is essential to develop recovery strategies so that the vehicle is not damaged. In this paper, we develop a model-free deep reinforcement learning approach for a quadrotor to recover from a single rotor failure. The approach is based on Soft-actor-critic that enables the vehicle to hover, land, and perform complex maneuvers. Simulation results are presented to validate the proposed approach using a custom simulator. The results show that the proposed approach achieves hover, landing, and path following in 2D and 3D. We also show that the proposed approach is robust to wind disturbances.


title: Enabling Large-Scale Federated Learning over Wireless Edge Networks

abstract: Major bottlenecks of large-scale Federated Learning(FL) networks are the high costs for communication and computation. This is due to the fact that most of current FL frameworks only consider a star network topology where all local trained models are aggregated at a single server (e.g., a cloud server). This causes significant overhead at the server when the number of users are huge and local models' sizes are large. This paper proposes a novel edge network architecture which decentralizes the model aggregation process at the server, thereby significantly reducing the aggregation latency of the whole network. In this architecture, we propose a highly-effective in-network computation protocol consisting of two components. First, an in-network aggregation process is designed so that the majority of aggregation computations can be offloaded from cloud server to edge nodes. Second, a joint routing and resource allocation optimization problem is formulated to minimize the aggregation latency for the whole system at every learning round. The problem turns out to be NP-hard, and thus we propose a polynomial time routing algorithm which can achieve near optimal performance with a theoretical bound. Numerical results show that our proposed framework can dramatically reduce the network latency, up to 4.6 times. Furthermore, this framework can significantly decrease cloud's traffic and computing overhead by a factor of K/M, where K is the number of users and M is the number of edge nodes, in comparison with conventional baselines.


title: Benchmarking Lane-changing Decision-making for Deep Reinforcement Learning

abstract: The development of autonomous driving has attracted extensive attention in recent years, and it is essential to evaluate the performance of autonomous driving. However, testing on the road is expensive and inefficient. Virtual testing is the primary way to validate and verify self-driving cars, and the basis of virtual testing is to build simulation scenarios. In this paper, we propose a training, testing, and evaluation pipeline for the lane-changing task from the perspective of deep reinforcement learning. First, we design lane change scenarios for training and testing, where the test scenarios include stochastic and deterministic parts. Then, we deploy a set of benchmarks consisting of learning and non-learning approaches. We train several state-of-the-art deep reinforcement learning methods in the designed training scenarios and provide the benchmark metrics evaluation results of the trained models in the test scenarios. The designed lane-changing scenarios and benchmarks are both opened to provide a consistent experimental environment for the lane-changing task.


title: Density estimates for the exponential functionals of fractional Brownian motion

abstract: In this note, we investigate the density of the exponential functional of the fractional Brownian motion. Based on the techniques of Malliavin's calculus, we provide a log-normal upper bound for the density.


title: Single Image Dehazing with An Independent Detail-Recovery Network

abstract: Single image dehazing is a prerequisite which affects the performance of many computer vision tasks and has attracted increasing attention in recent years. However, most existing dehazing methods emphasize more on haze removal but less on the detail recovery of the dehazed images. In this paper, we propose a single image dehazing method with an independent Detail Recovery Network (DRN), which considers capturing the details from the input image over a separate network and then integrates them into a coarse dehazed image. The overall network consists of two independent networks, named DRN and the dehazing network respectively. Specifically, the DRN aims to recover the dehazed image details through local and global branches respectively. The local branch can obtain local detail information through the convolution layer and the global branch can capture more global information by the Smooth Dilated Convolution (SDC). The detail feature map is fused into the coarse dehazed image to obtain the dehazed image with rich image details. Besides, we integrate the DRN, the physical-model-based dehazing network and the reconstruction loss into an end-to-end joint learning framework. Extensive experiments on the public image dehazing datasets (RESIDE-Indoor, RESIDE-Outdoor and the TrainA-TestA) illustrate the effectiveness of the modules in the proposed method and show that our method outperforms the state-of-the-art dehazing methods both quantitatively and qualitatively. The code is released in https://github.com/YanLi-LY/Dehazing-DRN.


title: Benchmarking Augmentation Methods for Learning Robust Navigation Agents: the Winning Entry of the 2021 iGibson Challenge

abstract: Recent advances in deep reinforcement learning and scalable photorealistic simulation have led to increasingly mature embodied AI for various visual tasks, including navigation. However, while impressive progress has been made for teaching embodied agents to navigate static environments, much less progress has been made on more dynamic environments that may include moving pedestrians or movable obstacles. In this study, we aim to benchmark different augmentation techniques for improving the agent's performance in these challenging environments. We show that adding several dynamic obstacles into the scene during training confers significant improvements in test-time generalization, achieving much higher success rates than baseline agents. We find that this approach can also be combined with image augmentation methods to achieve even higher success rates. Additionally, we show that this approach is also more robust to sim-to-sim transfer than image augmentation methods. Finally, we demonstrate the effectiveness of this dynamic obstacle augmentation approach by using it to train an agent for the 2021 iGibson Challenge at CVPR, where it achieved 1st place for Interactive Navigation. Video link: https://www.youtube.com/watch?v=HxUX2HeOSE4


title: Zero Poisson' s Ratio and Suppressed Mechanical Anisotropy in BP/SnSe Van der Waals Heterostructure: A First-principles Study

abstract: Black phosphorene and its analogs have attracted intensive attention due to their unique puckered structures, anisotropic characteristics, and negative Poisson's ratio. The van der Waals heterostructures assembly by stacking different materials may show novel physical properties which the parent materials don't possess. In this work, the first-principles calculations were performed to study the mechanical properties of the BP/SnSe van der Waals heterostructure. Interestingly, a near-zero Poisson's ratio vzx was found in BP/SnSe heterostructure. In addition, compared to the parent materials BP and SnSe with strong in-plane anisotropic mechanical properties, the BP/SnSe heterostructure shows strongly suppressed anisotropy. Our findings suggest that the vdW heterostructure could show quite different mechanical properties from the parent materials and provide new opportunities for the mechanical applications of the heterostructures.


title: Onset of universality in the dynamical mixing of a pure state

abstract: We study the time dynamics of random density matrices generated by evolving the same pure state using a Gaussian orthogonal ensemble (GOE) of Hamiltonians. We show that the spectral statistics of the resulting mixed state is well described by random matrix theory (RMT) and undergoes a crossover from the GOE to the Gaussian unitary ensemble (GUE) for short and large times respectively. Using a semi-analytical treatment relying on a power series of the density matrix as a function of time, we find that the crossover occurs in a characteristic time that scales as the inverse of the Hilbert space dimension. The RMT results are contrasted with a paradigmatic model of many-body localization in the chaotic regime, where the GUE statistics is reached at large times, while for short times the statistics strongly depends on the peculiarity of the considered subspace.


title: Vibration Improves Performance in Granular Jamming Grippers

abstract: Granular jamming is a popular soft robotics technology that has seen recent widespread applications including industrial gripping, surgical robotics and haptics. However, to date the field has not fully exploited the fundamental science of the jamming phase transition, which has been rigorously studied in the field of statistical and condensed matter physics. This work introduces vibration as a means to improve the properties of granular jamming grippers through vibratory fluidisation and the exploitation of resonant modes within the granular material. We show that vibration in soft jamming grippers can improve holding strength, reduce the downwards force needed for the gripping action, and lead to a simplified setup where the second air pump, generally used for unjamming, could be removed. In a series of studies, we show that frequency and amplitude of the waveforms are key determinants to performance, and that jamming performance is also dependent on temporal properties of the induced waveform. We hope to encourage further study in transitioning fundamental jamming mechanisms into a soft robotics context to improve performance and increase diversity of applications for granular jamming grippers.


title: A Simple Approach to Jointly Rank Passages and Select Relevant Sentences in the OBQA Context

abstract: In the open book question answering (OBQA) task, selecting the relevant passages and sentences from distracting information is crucial to reason the answer to a question. HotpotQA dataset is designed to teach and evaluate systems to do both passage ranking and sentence selection. Many existing frameworks use separate models to select relevant passages and sentences respectively. Such systems not only have high complexity in terms of the parameters of models but also fail to take the advantage of training these two tasks together since one task can be beneficial for the other one. In this work, we present a simple yet effective framework to address these limitations by jointly ranking passages and selecting sentences. Furthermore, we propose consistency and similarity constraints to promote the correlation and interaction between passage ranking and sentence selection.The experiments demonstrate that our framework can achieve competitive results with previous systems and outperform the baseline by 28\% in terms of exact matching of relevant sentences on the HotpotQA dataset.


title: Less is More: Learning from Synthetic Data with Fine-grained Attributes for Person Re-Identification

abstract: Person re-identification (re-ID) plays an important role in applications such as public security and video surveillance. Recently, learning from synthetic data, which benefits from the popularity of synthetic data engine, has attracted great attention from the public eyes. However, existing datasets are limited in quantity, diversity and realisticity, and cannot be efficiently used for re-ID problem. To address this challenge, we manually construct a large-scale person dataset named FineGPR with fine-grained attribute annotations. Moreover, aiming to fully exploit the potential of FineGPR and promote the efficient training from millions of synthetic data, we propose an attribute analysis pipeline called AOST, which dynamically learns attribute distribution in real domain, then eliminates the gap between synthetic and real-world data and thus is freely deployed to new scenarios. Experiments conducted on benchmarks demonstrate that FineGPR with AOST outperforms (or is on par with) existing real and synthetic datasets, which suggests its feasibility for re-ID task and proves the proverbial less-is-more principle. Our synthetic FineGPR dataset is publicly available at https://github.com/JeremyXSC/FineGPR.


title: Joint Optical Neuroimaging Denoising with Semantic Tasks

abstract: Optical neuroimaging is a vital tool for understanding the brain structure and the connection between regions and nuclei. However, the image noise introduced in the sample preparation and the imaging system hinders the extraction of the possible knowlege from the dataset, thus denoising for the optical neuroimaging is usually necessary. The supervised denoisng methods often outperform the unsupervised ones, but the training of the supervised denoising models needs the corresponding clean labels, which is not always avaiable due to the high labeling cost. On the other hand, those semantic labels, such as the located soma positions, the reconstructed neuronal fibers, and the nuclei segmentation result, are generally available and accumulated from everyday neuroscience research. This work connects a supervised denoising and a semantic segmentation model together to form a end-to-end model, which can make use of the semantic labels while still provides a denoised image as an intermediate product. We use both the supervised and the self-supervised models for the denoising and introduce a new cost term for the joint denoising and the segmentation setup. We test the proposed approach on both the synthetic data and the real-world data, including the optical neuroimaing dataset and the electron microscope dataset. The result shows that the joint denoising result outperforms the one using the denoising method alone and the joint model benefits the segmentation and other downstream task as well.


title: HyperExpan: Taxonomy Expansion with Hyperbolic Representation Learning

abstract: Taxonomies are valuable resources for many applications, but the limited coverage due to the expensive manual curation process hinders their general applicability. Prior works attempt to automatically expand existing taxonomies to improve their coverage by learning concept embeddings in Euclidean space, while taxonomies, inherently hierarchical, more naturally align with the geometric properties of a hyperbolic space. In this paper, we present HyperExpan, a taxonomy expansion algorithm that seeks to preserve the structure of a taxonomy in a more expressive hyperbolic embedding space and learn to represent concepts and their relations with a Hyperbolic Graph Neural Network (HGNN). Specifically, HyperExpan leverages position embeddings to exploit the structure of the existing taxonomies, and characterizes the concept profile information to support the inference on unseen concepts during training. Experiments show that our proposed HyperExpan outperforms baseline models with representation learning in a Euclidean feature space and achieves state-of-the-art performance on the taxonomy expansion benchmarks.


title: Third-party Evaluation of Robotic Hand Designs Using a Mechanical Glove

abstract: A robotic hand design suitable for dexterity should be examined using functional tests. To achieve this, we designed a mechanical glove, which is a rigid wearable glove that enables us to develop the corresponding isomorphic robotic hand and evaluate its hardware properties. Subsequently, the effectiveness of multiple degrees-of-freedom (DOFs) was evaluated by human participants. Several fine motor skills were evaluated using the mechanical glove under two conditions: one- and three-DOF conditions. To the best of our knowledge, this is the first extensive evaluation method for robotic hand designs suitable for dexterity. (This paper was peer-reviewed and is the full translation from the Journal of the Robotics Society of Japan, Vol.39, No.6, pp.557-560, 2021.)


title: A Spectral Approach to Off-Policy Evaluation for POMDPs

abstract: We consider off-policy evaluation (OPE) in Partially Observable Markov Decision Processes, where the evaluation policy depends only on observable variables but the behavior policy depends on latent states (Tennenholtz et al. (2020a)). Prior work on this problem uses a causal identification strategy based on one-step observable proxies of the hidden state, which relies on the invertibility of certain one-step moment matrices. In this work, we relax this requirement by using spectral methods and extending one-step proxies both into the past and future. We empirically compare our OPE methods to existing ones and demonstrate their improved prediction accuracy and greater generality. Lastly, we derive a separate Importance Sampling (IS) algorithm which relies on rank, distinctness, and positivity conditions, and not on the strict sufficiency conditions of observable trajectories with respect to the reward and hidden-state structure required by Tennenholtz et al. (2020a).


title: Identifying Potential Exomoon Signals with Convolutional Neural Networks

abstract: Targeted observations of possible exomoon host systems will remain difficult to obtain and time-consuming to analyze in the foreseeable future. As such, time-domain surveys such as Kepler, K2 and TESS will continue to play a critical role as the first step in identifying candidate exomoon systems, which may then be followed-up with premier ground- or space-based telescopes. In this work, we train an ensemble of convolutional neural networks (CNNs) to identify candidate exomoon signals in single-transit events observed by Kepler. Our training set consists of ${\sim}$27,000 examples of synthetic, planet-only and planet+moon single transits, injected into Kepler light curves. We achieve up to 88\% classification accuracy with individual CNN architectures and 97\% precision in identifying the moons in the validation set when the CNN ensemble is in total agreement. We then apply the CNN ensemble to light curves from 1880 Kepler Objects of Interest with periods $>10$ days ($\sim$57,000 individual transits), and further test the accuracy of the CNN classifier by injecting planet transits into each light curve, thus quantifying the extent to which residual stellar activity may result in false positive classifications. We find a small fraction of these transits contain moon-like signals, though we caution against strong inferences of the exomoon occurrence rate from this result. We conclude by discussing some ongoing challenges to utilizing neural networks for the exomoon search.


title: KD-VLP: Improving End-to-End Vision-and-Language Pretraining with Object Knowledge Distillation

abstract: Self-supervised vision-and-language pretraining (VLP) aims to learn transferable multi-modal representations from large-scale image-text data and to achieve strong performances on a broad scope of vision-language tasks after finetuning. Previous mainstream VLP approaches typically adopt a two-step strategy relying on external object detectors to encode images in a multi-modal Transformer framework, which suffer from restrictive object concept space, limited image context and inefficient computation. In this paper, we propose an object-aware end-to-end VLP framework, which directly feeds image grid features from CNNs into the Transformer and learns the multi-modal representations jointly. More importantly, we propose to perform object knowledge distillation to facilitate learning cross-modal alignment at different semantic levels. To achieve that, we design two novel pretext tasks by taking object features and their semantic labels from external detectors as supervision: 1.) Object-guided masked vision modeling task focuses on enforcing object-aware representation learning in the multi-modal Transformer; 2.) Phrase-region alignment task aims to improve cross-modal alignment by utilizing the similarities between noun phrases and object labels in the linguistic space. Extensive experiments on a wide range of vision-language tasks demonstrate the efficacy of our proposed framework, and we achieve competitive or superior performances over the existing pretraining strategies.


title: Sensor-Based Satellite IoT for Early Wildfire Detection

abstract: Frequent and severe wildfires have been observed lately on a global scale. Wildfires not only threaten lives and properties, but also pose negative environmental impacts that transcend national boundaries (e.g., greenhouse gas emission and global warming). Thus, early wildfire detection with timely feedback is much needed. We propose to use the emerging beyond fifth-generation (B5G) and sixth-generation (6G) satellite Internet of Things (IoT) communication technology to enable massive sensor deployment for wildfire detection. We propose wildfire and carbon emission models that take into account real environmental data including wind speed, soil wetness, and biomass, to simulate the fire spreading process and quantify the fire burning areas, carbon emissions, and economical benefits of the proposed system against the backdrop of recent California wildfires. We also conduct a satellite IoT feasibility check by analyzing the satellite link budget. Future research directions to further illustrate the promise of the proposed system are discussed.


title: Tecnologica cosa: Modeling Storyteller Personalities in Boccaccio's Decameron

abstract: We explore Boccaccio's Decameron to see how digital humanities tools can be used for tasks that have limited data in a language no longer in contemporary use: medieval Italian. We focus our analysis on the question: Do the different storytellers in the text exhibit distinct personalities? To answer this question, we curate and release a dataset based on the authoritative edition of the text. We use supervised classification methods to predict storytellers based on the stories they tell, confirming the difficulty of the task, and demonstrate that topic modeling can extract thematic storyteller "profiles."


title: Controller-and-Stopper Stochastic Differential Games with Regime Switching

abstract: This paper is concerned with the controller-and-stopper stochastic differential game under a regime switching model in an infinite horizon. The state of the system consists of a number of diffusions \emph{coupled} by a continuous-time finite-state Markov chain. There are two players, one called the controller and the other called the stopper, involved in the game. The goal is to find a saddle point for the two players up to the time that the stopper \emph{terminates} the game. Based on the dynamic programming principle (DPP, for short), the lower and upper value functions are shown to be the viscosity supersolution and viscosity subsolution of the associated Hamilton-Jacobi-Bellman (HJB, for short) equation, respectively. Further, in view of the comparison principle for viscosity solutions, the lower and upper value functions \emph{coincide}, which implies that the game admits a value. All the proofs in this paper are strikingly different from those for the case without regime switching.


title: Vertex-primitive s-arc-transitive digraphs admitting a Suzuki or Ree group

abstract: The investigation of s-arc-transitivity of digraphs can be dated back to 1989 when the third author showed that s can be arbitrarily large if the action on vertices is imprimitive. However, the situation is completely different when the digraph is vertex-primitive and not a directed cycle. In 2017 the second author, Li and Xia constructed the first infinite family of G-vertex-primitive 2-arc-transitive examples, and asked if there is an upper bound on s for G-vertex-primitive s-arc-transitive digraphs w=that are not directed. In 2018 the second author and Xia showed that if there is a largest such value of s then it will occur when G is almost simple. So far it has been shown that s\leq 2 for almost simple groups whose socle is an alternating group or a projective special linear group. The contribution of this paper is to prove that s\leq 1 in the case of the Suzuki and the small Ree groups. We give constructions with s=1 to show that the bound is sharp.


title: Unsupervised Contextualized Document Representation

abstract: Several NLP tasks need the effective representation of text documents. Arora et. al., 2017 demonstrate that simple weighted averaging of word vectors frequently outperforms neural models. SCDV (Mekala et. al., 2017) further extends this from sentences to documents by employing soft and sparse clustering over pre-computed word vectors. However, both techniques ignore the polysemy and contextual character of words. In this paper, we address this issue by proposing SCDV+BERT(ctxd), a simple and effective unsupervised representation that combines contextualized BERT (Devlin et al., 2019) based word embedding for word sense disambiguation with SCDV soft clustering approach. We show that our embeddings outperform original SCDV, pre-train BERT, and several other baselines on many classification datasets. We also demonstrate our embeddings effectiveness on other tasks, such as concept matching and sentence similarity. In addition, we show that SCDV+BERT(ctxd) outperforms fine-tune BERT and different embedding approaches in scenarios with limited data and only few shots examples.


title: FCM: A Fine-grained Comparison Model for Multi-turn Dialogue Reasoning

abstract: Despite the success of neural dialogue systems in achieving high performance on the leader-board, they cannot meet users' requirements in practice, due to their poor reasoning skills. The underlying reason is that most neural dialogue models only capture the syntactic and semantic information, but fail to model the logical consistency between the dialogue history and the generated response. Recently, a new multi-turn dialogue reasoning task has been proposed, to facilitate dialogue reasoning research. However, this task is challenging, because there are only slight differences between the illogical response and the dialogue history. How to effectively solve this challenge is still worth exploring. This paper proposes a Fine-grained Comparison Model (FCM) to tackle this problem. Inspired by human's behavior in reading comprehension, a comparison mechanism is proposed to focus on the fine-grained differences in the representation of each response candidate. Specifically, each candidate representation is compared with the whole history to obtain a history consistency representation. Furthermore, the consistency signals between each candidate and the speaker's own history are considered to drive a model to prefer a candidate that is logically consistent with the speaker's history logic. Finally, the above consistency representations are employed to output a ranking list of the candidate responses for multi-turn dialogue reasoning. Experimental results on two public dialogue datasets show that our method obtains higher ranking scores than the baseline models.


title: The quantum mechanics canonically associated to free probability Part I: Free momentum and associated kinetic energy

abstract: After a short review of the quantum mechanics canonically associated with a classical real valued random variable with all moments, we begin to study the quantum mechanics canonically associated to the \textbf{standard semi--circle random variable} $X$, characterized by the fact that its probability distribution is the semi--circle law $\mu$ on $[-2,2]$. We prove that, in the identification of $L^2([-2,2],\mu)$ with the $1$--mode interacting Fock space $\Gamma_{\mu}$, defined by the orthogonal polynomial gradation of $\mu$, $X$ is mapped into position operator and its canonically associated momentum operator $P$ into $i$ times the $\mu$--Hilbert transform $H_{\mu}$ on $L^2([-2,2],\mu)$. In the first part of the present paper, after briefly describing the simpler case of the $\mu$--harmonic oscillator, we find an explicit expression for the action, on the $\mu$--orthogonal polynomials, of the semi--circle analogue of the translation group $e^{itP}$ and of the semi--circle analogue of the free evolution $e^{itP^2/2}$ respectively in terms of Bessel functions of the first kind and of confluent hyper--geometric series. These results require the solution of the \textit{inverse normal order problem} on the quantum algebra canonically associated to the classical semi--circle random variable and are derived in the second part of the present paper. Since the problem to determine, with purely analytic techniques, the explicit form of the action of $e^{-tH_{\mu}}$ and $e^{-itH_{\mu}^2/2}$ on the $\mu$--orthogonal polynomials is difficult, % aaa ask T if it is solved the above mentioned results show the power of the combination of these techniques with those developed within the algebraic approach to the theory of orthogonal polynomials.


title: Backdoor Attacks on Federated Learning with Lottery Ticket Hypothesis

abstract: Edge devices in federated learning usually have much more limited computation and communication resources compared to servers in a data center. Recently, advanced model compression methods, like the Lottery Ticket Hypothesis, have already been implemented on federated learning to reduce the model size and communication cost. However, Backdoor Attack can compromise its implementation in the federated learning scenario. The malicious edge device trains the client model with poisoned private data and uploads parameters to the center, embedding a backdoor to the global shared model after unwitting aggregative optimization. During the inference phase, the model with backdoors classifies samples with a certain trigger as one target category, while shows a slight decrease in inference accuracy to clean samples. In this work, we empirically demonstrate that Lottery Ticket models are equally vulnerable to backdoor attacks as the original dense models, and backdoor attacks can influence the structure of extracted tickets. Based on tickets' similarities between each other, we provide a feasible defense for federated learning against backdoor attacks on various datasets.


title: Anti-degenerated UWB-LiDAR Localization for Automatic Road Roller in Tunnel

abstract: The automatic road roller, as a popular type of construction robot, has attracted much interest from both the industry and the research community in recent years. However, when it comes to tunnels where the degeneration issues are prone to happen, it is still a challenging problem to provide an accurate positioning result for the robot. In this paper, we aim to deal with this problem by fusing LiDAR and UWB measurements based on optimization. In the proposed localization method, the directions of non-degeneration will be constrained and the covariance of UWB reconstruction will be introduced to improve the accuracy of localization. Apart from these, a method that can extract the feature of the inner wall of tunnels to assist positioning is also presented in this paper. To evaluate the effectiveness of the proposed method, three experiments with real road roller were carried out and the results show that our method can achieve better performance than the existing methods and can be applied to automatic road roller working inside tunnels. Finally, we discuss the feasibility of deploying the system in real applications and make several recommendations.


title: Towards The Automatic Coding of Medical Transcripts to Improve Patient-Centered Communication

abstract: This paper aims to provide an approach for automatic coding of physician-patient communication transcripts to improve patient-centered communication (PCC). PCC is a central part of high-quality health care. To improve PCC, dialogues between physicians and patients have been recorded and tagged with predefined codes. Trained human coders have manually coded the transcripts. Since it entails huge labor costs and poses possible human errors, automatic coding methods should be considered for efficiency and effectiveness. We adopted three machine learning algorithms (Na\"ive Bayes, Random Forest, and Support Vector Machine) to categorize lines in transcripts into corresponding codes. The result showed that there is evidence to distinguish the codes, and this is considered to be sufficient for training of human annotators.


title: Optically Pumped AlGaN Double Heterostructure Deep-UV Laser by Molecular Beam Homoepitaxy: Mirror Imperfections and Cavity Loss

abstract: We demonstrate the first optically pumped sub-300 nm UV laser structures grown by plasma-assisted molecular beam epitaxy on single-crystal bulk AlN. The edge-emitting laser structures fabricated with the AlN/AlGaN heterostructures exhibit multi-mode emission with peak gain at ~284 nm. Having the goal of electrically injected, continuous wave deep-UV AlGaN laser diodes in mind, with its intrinsic material challenges of achieving sufficient optical gain, the optical cavity loss of a laser diode should be minimized. We derive an expression to quantify the effect of mirror imperfections, including slant and surface roughness on the optical mirror loss of a Fabry-P\'erot cavity. It is found that the optical imperfection loss is a superlinear function of the RMS roughness and slant angle of the facets, and also scales as the inverse wavelength squared of the principal lasing mode. This highlights the importance of device processing optimization as Fabry-P\'erot cavities couple to lower wavelengths.

categories: physics.optics cond-mat.mes-hall cond-mat.mtrl-sci physics.app-ph


title: Antibunching via cooling by heating

abstract: We investigate statistics of the photon (phonon) field undergoing linear and nonlinear damping processes. An effective two-photon (phonon) nonlinear "cooling by heating" process is realized from linear damping by spectral filtering of the heat baths present in the system. This cooling process driven by incoherent quantum thermal noise can create quantum states of the photon field. In fact, for high temperatures of the spectrally filtered heat baths, sub-Poissonian statistics with strong antibunching in the photon (phonon) field are reported. This notion of the emergence and control of quantumness by incoherent thermal quantum noise is applied to a quantum system comprising of a two-level system and a harmonic oscillator or analogous optomechanical setting. Our analysis may provide a promising direction for the preparation and protection of quantum features via nonlinear damping that can be controlled with incoherent thermal quantum noise.


title: Does Foreign Debt Contribute to Economic Growth?

abstract: We study the relationship between foreign debt and GDP growth using a panel dataset of 50 countries from 1997 to 2015. We find that economic growth correlates positively with foreign debt and that the relationship is causal in nature by using the sovereign credit default swap spread as an instrumental variable. Furthermore, we find that foreign debt increases investment and then GDP growth in subsequent years. Our findings suggest that lower sovereign default risks lead to higher foreign debt contributing to GDP growth more in OECD than non-OECD countries.


title: Effect of passive metallic layers on muon energy estimation by means of deflection angle for muon scattering tomography: A comparative study based on GEANT4 simulations

abstract: In the tomographic configurations based on the muon scattering, the angular variation with respect to the kinetic energy indirectly brings forth the ability to coarsely predict the kinetic energy by using the deflection angle owing to the detector layers. Nevertheless, the angular deviation due to the detector components is expected to be minuscule in addition to a relatively high uncertainty in the case of the plastic scintillators. In the present study, we contrast our current tomographic prototype, which consists of the detector layers manufactured from polyvinyl toluene besides a detector accuracy of 1 mrad, with an alternative hodoscope scheme containing stainless steel layers by aiming to investigate the three-group energy structure. Initially, we determine the average deflection angles together with the corresponding standard deviations for our present setup as well as for the alternative scheme by means of the GEANT4 simulations. In the second place, we express a brace of misclassification probabilities founded on the standard deviations where the first procedure assumes a linear finite approximation, whereas the latter approach rests on a positively defined modified Gaussian distribution. Upon our simulation results, we demonstrate that the introduced stainless steel layers in the proposed hodoscope setup do not only serve to augment the average deflection angles, but they also diminish the misclassification probabilities, therewith reducing the classification uncertainty apart from an improved detection performance.


title: Topological Quantum Criticality in non-Hermitian Kitaev chain with Longer Range Interaction

abstract: An Attempt is made to study the non-Hermitian effect on the topological quantum criticality and also in the physics of Majroana zero mode (MZMs). In this work, the effects and modifications done by the non-Hermitian factor $\gamma$ on the topological phases, criticality and also in the MZMs is studied. We use the zero mode solutions (ZMS) to construct the phase diagram. We find a correspondence between Hermitian and non-Hermitian model Hamiltonian. The MZMs appear at criticality and has a stability dependence on the new passage created because of the introduction of non-Hermiticity. The multicritical points are also studied to understand their nature under the influence of non-Hemiticity. We also study the effect of non-Hermiticity on the topological phases.


title: Note on the Tur\'an number of the $3$-linear hypergraph $C_{13}$

abstract: Let the crown $C_{13}$ be the linear $3$-graph on $9$ vertices $\{a,b,c,d,e,f,g,h,i\}$ with edges $$E = \{\{a,b,c\}, \{a, d,e\}, \{b, f, g\}, \{c, h,i\}\}.$$ Proving a conjecture of Gy\'arf\'as et. al., we show that for any crown-free linear $3$-graph $G$ on $n$ vertices, its number of edges satisfy $$\lvert E(G) \rvert \leq \frac{3(n - s)}{2}$$ where $s$ is the number of vertices in $G$ with degree at least $6$. This result, combined with previous work, essentially completes the determination of linear Tur\'an number for linear $3$-graphs with at most $4$ edges.


title: Incorporating Data Uncertainty in Object Tracking Algorithms

abstract: Methodologies for incorporating the uncertainties characteristic of data-driven object detectors into object tracking algorithms are explored. Object tracking methods rely on measurement error models, typically in the form of measurement noise, false positive rates, and missed detection rates. Each of these quantities, in general, can be dependent on object or measurement location. However, for detections generated from neural-network processed camera inputs, these measurement error statistics are not sufficient to represent the primary source of errors, namely a dissimilarity between run-time sensor input and the training data upon which the detector was trained. To this end, we investigate incorporating data uncertainty into object tracking methods such as to improve the ability to track objects, and particularly those which out-of-distribution w.r.t. training data. The proposed methodologies are validated on an object tracking benchmark as well on experiments with a real autonomous aircraft.


title: Minimax Rates and Adaptivity in Combining Experimental and Observational Data

abstract: Randomized controlled trials (RCTs) are the gold standard for evaluating the causal effect of a treatment; however, they often have limited sample sizes and sometimes poor generalizability. On the other hand, non-randomized, observational data derived from large administrative databases have massive sample sizes and better generalizability, but they are prone to unmeasured confounding bias. It is thus of considerable interest to reconcile effect estimates obtained from randomized controlled trials and observational studies investigating the same intervention, potentially harvesting the best from both realms. In this paper, we theoretically characterize the potential efficiency gain of integrating observational data into the RCT-based analysis from a minimax point of view. For estimation, we derive the minimax rate of convergence for the mean squared error, and propose a fully adaptive anchored thresholding estimator that attains the optimal rate up to poly-log factors. For inference, we characterize the minimax rate for the length of confidence intervals and show that adaptation (to unknown confounding bias) is in general impossible. A curious phenomenon thus emerges: for estimation, the efficiency gain from data integration can be achieved without prior knowledge on the magnitude of the confounding bias; for inference, the same task becomes information-theoretically impossible in general. We corroborate our theoretical findings using simulations and a real data example from the RCT DUPLICATE initiative [Franklin et al., 2021b].


title: Investigating and Modeling the Dynamics of Long Ties

abstract: Long ties, the social ties that bridge different communities, are widely believed to play crucial roles in spreading novel information in social networks. However, some existing network theories and prediction models indicate that long ties might dissolve quickly or eventually become redundant, thus putting into question the long-term value of long ties. Our empirical analysis of real-world dynamic networks shows that contrary to such reasoning, long ties are more likely to persist than other social ties, and that many of them constantly function as social bridges without being embedded in local networks. Using a novel cost-benefit analysis model combined with machine learning, we show that long ties are highly beneficial, which instinctively motivates people to expend extra effort to maintain them. This partly explains why long ties are more persistent than what has been suggested by many existing theories and models. Overall, our study suggests the need for social interventions that can promote the formation of long ties, such as mixing people with diverse backgrounds.


title: A Method For Adding Motion-Blur on Arbitrary Objects By using Auto-Segmentation and Color Compensation Techniques

abstract: When dynamic objects are captured by a camera, motion blur inevitably occurs. Such a blur is sometimes considered as just a noise, however, it sometimes gives an important effect to add dynamism in the scene for photographs or videos. Unlike the similar effects, such as defocus blur, which is now easily controlled even by smartphones, motion blur is still uncontrollable and makes undesired effects on photographs. In this paper, an unified framework to add motion blur on per-object basis is proposed. In the method, multiple frames are captured without motion blur and they are accumulated to create motion blur on target objects. To capture images without motion blur, shutter speed must be short, however, it makes captured images dark, and thus, a sensor gain should be increased to compensate it. Since a sensor gain causes a severe noise on image, we propose a color compensation algorithm based on non-linear filtering technique for solution. Another contribution is that our technique can be used to make HDR images for fast moving objects by using multi-exposure images. In the experiments, effectiveness of the method is confirmed by ablation study using several data sets.


title: Perturbative renormalization of the $T \bar{T}$-deformed free massive Dirac fermion

abstract: In this paper we explicitly carry out the perturbative renormalization of the $T\bar{T}$-deformed free massive Dirac fermion in two dimensions up to second order in the coupling constant. This is done by computing the two-to-two $S$-matrix using the LSZ reduction formula and canceling out the divergences by introducing counterterms. We demonstrate that the renormalized Lagrangian is unambiguously determined by demanding that it gives the correct $S$-matrix of a $T\bar{T}$-deformed integrable field theory. Remarkably, the renormalized Lagrangian is qualitatively very different from its classical counterpart.


title: Extremism & Whataboutism: A Case Study on Bangalore Riots

abstract: A common diversionary tactic used to deflect attention from contested issues is whataboutery which, when used by majoritarian groups to justify their behaviour against marginalised communities, can quickly devolve into extremism. We explore the manifestations of extreme speech in the Indian context, through a case study of violent protests and policing in the city of Bangalore, provoked by a derogatory Facebook post. Analyses of the dominant narratives on Twitter surrounding the incident reveal that, most of them employ whataboutism to deflect attention from the triggering post and serve as breeding grounds for religion-based extreme speech. We conclude by discussing how our study proposes an alternative lens of viewing extremism in the Global South.


title: SnAs: a 4K weak type-II superconductor with non-trivial band topology

abstract: Superconductors with non-trivial band topology are emerging as one of the best avenues to study quantum anomalies and experimental realization of Majorana Fermions. This article reports the successful crystal growth of superconducting SnAs, which can have topologically non-trivial states, as evidenced in DFT (Density Functional Theory) calculations, Z2 invariants, and topologically surface state. Here, we followed a two-step method to grow SnAs crystal. The powder XRD (X-ray Diffractometry) pattern of synthesized crystal ensures that the crystal is grown in a single phase with a NaCl type cubic structure and the EDAX (Energy Dispersive X-ray Analysis) endorses the stoichiometry of the as-grown sample. The DFT calculations performed with and without the inclusion of spin-orbit coupling (SOC) show band inversion at various K symmetry points near the Fermi level. The recorded Raman spectra show two different modes, which are assigned as A1 and ETO vibrations. The ZFC (Zero-Field Cooled) & FC (Field Cooled), as well as the isothermal M-H (Magnetization vs. field) measurements, are also performed for the topological non-trivial SnAs superconductor, which eventually confirms the weak type-II superconductivity at 4K. Various other superconductivity parameters viz. kappa parameter, coherence length, and penetration depth are also calculated to probe the as-grown sample's characteristics.


title: A unified interpretation of the Gaussian mechanism for differential privacy through the sensitivity index

abstract: The Gaussian mechanism (GM) represents a universally employed tool for achieving differential privacy (DP), and a large body of work has been devoted to its analysis. We argue that the three prevailing interpretations of the GM, namely $(\varepsilon, \delta)$-DP, f-DP and R\'enyi DP can be expressed by using a single parameter $\psi$, which we term the sensitivity index. $\psi$ uniquely characterises the GM and its properties by encapsulating its two fundamental quantities: the sensitivity of the query and the magnitude of the noise perturbation. With strong links to the ROC curve and the hypothesis-testing interpretation of DP, $\psi$ offers the practitioner a powerful method for interpreting, comparing and communicating the privacy guarantees of Gaussian mechanisms.


title: Numerical Continued Fraction Interpolation

abstract: We show that highly accurate approximations can often be obtained from constructing Thiele interpolating continued fractions by a Greedy selection of the interpolation points together with an early termination condition. The obtained results are comparable with the outcome from state-of-the-art rational interpolation techniques based on the barycentric form.


title: Characterizations of some groups in terms of centralizers

abstract: A group $G$ is said to be $n$-centralizer if its number of element centralizers $\mid \Cent(G)\mid=n$, an F-group if every non-central element centralizer contains no other element centralizer and a CA-group if all non-central element centralizers are abelian. For any non-abelian $n$-centralizer group $G$, we prove that $\mid \frac{G}{Z(G)}\mid \leq (n-2)^2$, if $n \leq 12$ and $\mid \frac{G}{Z(G)}\mid \leq 2(n-4)^{{log}_2^{(n-4)}}$ otherwise, which improves an earlier result. We prove that if $G$ is an arbitrary non-abelian $n$-centralizer F-group, then gcd$(n-2, \mid \frac{G}{Z(G)}\mid) \neq 1$. For a finite F-group $G$, we show that $\mid \Cent(G)\mid \geq \frac{\mid G \mid}{2}$ iff $G \cong A_4 $, an extraspecial $2$-group or a Frobenius group with abelian kernel and complement of order $2$. Among other results, for a finite group $G$ with non-trivial center, it is proved that $\mid \Cent(G)\mid = \frac{\mid G \mid }{2}$ iff $G$ is an extraspecial $2$-group. We give a family of F-groups which are not CA-groups and extend an earlier result.


title: Annihilators of local cohomology modules and restricted flat dimensions

abstract: Yoshizawa investigated when local cohomology modules have an annihilator that does not depend on the choice of the defining ideal. In this paper we refine his results and investigate the relationship between annihilators of local cohomology modules and restricted flat dimensions.


title: Relativistic electron flux model in the outer radiation belt using a neural network approach

abstract: We present a machine-learning-based model of relativistic electron fluxes >1.8 MeV using a neural network approach in the Earth's outer radiation belt. The Outer RadIation belt Electron Neural net model for Relativistic electrons (ORIENT-R) uses only solar wind conditions and geomagnetic indices as input. For the first time, we show that the state of the outer radiation belt can be determined using only solar wind conditions and geomagnetic indices, without any initial and boundary conditions. The most important features for determining outer radiation belt dynamics are found to be AL, solar wind flow speed and density, and SYM-H indices. ORIENT-R reproduces out-of-sample relativistic electron fluxes with a correlation coefficient of 0.95 and an uncertainty factor of ~2. ORIENT-R reproduces radiation belt dynamics during an out-of-sample geomagnetic storm with good agreement to the observations. In addition, ORIENT-R was run for a completely out-of-sample period between March 2018 and October 2019 when the AL index ended and was replaced with the predicted AL index (lasp.colorado.edu/~lix). It reproduces electron fluxes with a correlation coefficient of 0.92 and an out-of-sample uncertainty factor of ~3. Furthermore, ORIENT-R captured the trend in the electron fluxes from low-earth-orbit (LEO) SAMPEX, which is a completely out-of-sample dataset both temporally and spatially. In sum, the ORIENT-R model can reproduce transport, acceleration, decay, and dropouts of the outer radiation belt anywhere from short timescales (i.e., geomagnetic storms) and very long timescales (i.e., solar cycle) variations.


title: Perfect diffraction metagratings supporting bound states in the continuum and exceptional points

abstract: Resonance coupling in non-Hermitian systems can lead to exotic features, such as bound states in the continuum (BICs) and exceptional points (EPs), which have been widely employed to control the propagation and scattering of light. Yet, similar tools to control diffraction and engineering spatial wavefronts have remained elusive. Here, we show that, by operating a suitably tailored metagrating around a BIC and EPs, it is possible to achieve an extreme degree of control over coupling to different diffraction orders in metasurfaces. We stack subwavelength metallic slit arrays on a metal-insulator-metal waveguide, enabling a careful control of the coupling between localized and guided modes. By periodically tuning the coupling strength from weak to strong, we largely tailor the overall spectrum and enable the emergence of singular features, like BICs and EPs. Perfect unitary diffraction efficiency with large spectrum selectivity is achieved around these singular features, with promising applications for arbitrary wavefront shaping combined with filtering and sensing.


title: Role of Language Relatedness in Multilingual Fine-tuning of Language Models: A Case Study in Indo-Aryan Languages

abstract: We explore the impact of leveraging the relatedness of languages that belong to the same family in NLP models using multilingual fine-tuning. We hypothesize and validate that multilingual fine-tuning of pre-trained language models can yield better performance on downstream NLP applications, compared to models fine-tuned on individual languages. A first of its kind detailed study is presented to track performance change as languages are added to a base language in a graded and greedy (in the sense of best boost of performance) manner; which reveals that careful selection of subset of related languages can significantly improve performance than utilizing all related languages. The Indo-Aryan (IA) language family is chosen for the study, the exact languages being Bengali, Gujarati, Hindi, Marathi, Oriya, Punjabi and Urdu. The script barrier is crossed by simple rule-based transliteration of the text of all languages to Devanagari. Experiments are performed on mBERT, IndicBERT, MuRIL and two RoBERTa-based LMs, the last two being pre-trained by us. Low resource languages, such as Oriya and Punjabi, are found to be the largest beneficiaries of multilingual fine-tuning. Textual Entailment, Entity Classification, Section Title Prediction, tasks of IndicGLUE and POS tagging form our test bed. Compared to monolingual fine tuning we get relative performance improvement of up to 150% in the downstream tasks. The surprise take-away is that for any language there is a particular combination of other languages which yields the best performance, and any additional language is in fact detrimental.


title: Cram\'er-Rao bound-informed training of neural networks for quantitative MRI

abstract: Neural networks are increasingly used to estimate parameters in quantitative MRI, in particular in magnetic resonance fingerprinting. Their advantages over the gold standard non-linear least square fitting are their superior speed and their immunity to the non-convexity of many fitting problems. We find, however, that in heterogeneous parameter spaces, i.e. in spaces in which the variance of the estimated parameters varies considerably, good performance is hard to achieve and requires arduous tweaking of the loss function, hyper parameters, and the distribution of the training data in parameter space. Here, we address these issues with a theoretically well-founded loss function: the Cram\'er-Rao bound (CRB) provides a theoretical lower bound for the variance of an unbiased estimator and we propose to normalize the squared error with respective CRB. With this normalization, we balance the contributions of hard-to-estimate and not-so-hard-to-estimate parameters and areas in parameter space, and avoid a dominance of the former in the overall training loss. Further, the CRB-based loss function equals one for a maximally-efficient unbiased estimator, which we consider the ideal estimator. Hence, the proposed CRB-based loss function provides an absolute evaluation metric. We compare a network trained with the CRB-based loss with a network trained with the commonly used means squared error loss and demonstrate the advantages of the former in numerical, phantom, and in vivo experiments.


title: A reduction of the string bracket to the loop product

abstract: The negative cyclic homology for a differential graded algebra over the rational field has a quotient of the Hochschild homology as a direct summand if the $S$-action is trivial. With this fact, we show that the string bracket in the sense of Chas and Sullivan is reduced to the loop product followed by the BV operator on the loop homology provided the given manifold is BV exact. The reduction is indeed derived from the equivalence between the BV exactness and the triviality of the $S$-action. Moreover, it is proved that a Lie bracket on the loop cohomology of the classifying space of a connected compact Lie group possesses the same reduction. By using these results, we consider the non-triviality of string brackets. Another highlight is that a simply-connected space with positive weights is BV exact. Furthermore, the higher BV exactness is also discussed featuring the cobar-type Eilenberg-Moore spectral sequence.


title: Geometric Howe dualities of finite type

abstract: We develop a geometric approach toward an interplay between a pair of quantum Schur algebras of arbitrary finite type. Then by Beilinson-Lusztig-MacPherson's stabilization procedure in the setting of partial flag varieties of type A (resp. type B/C), the Howe duality between a pair of quantum general linear groups (resp. a pair of $\imath$quantum groups of type AIII/IV) is established. The Howe duality for quantum general linear groups has been provided via quantum coordinate algebras in [Z02]. We also generalize this algebraic approach to $\imath$quantum groups of type AIII/IV, and prove that the quantum Howe duality derived from partial flag varieties coincides with the one constructed by quantum coordinate (co)algebras. Moreover, the explicit multiplicity-free decompositions for these Howe dualities are obtained.


title: Index $t$-SNE: Tracking Dynamics of High-Dimensional Datasets with Coherent Embeddings

abstract: $t$-SNE is an embedding method that the data science community has widely Two interesting characteristics of t-SNE are the structure preservation property and the answer to the crowding problem, where all neighbors in high dimensional space cannot be represented correctly in low dimensional space. $t$-SNE preserves the local neighborhood, and similar items are nicely spaced by adjusting to the local density. These two characteristics produce a meaningful representation, where the cluster area is proportional to its size in number, and relationships between clusters are materialized by closeness on the embedding. This algorithm is non-parametric, therefore two initializations of the algorithm would lead to two different embedding. In a forensic approach, analysts would like to compare two or more datasets using their embedding. An approach would be to learn a parametric model over an embedding built with a subset of data. While this approach is highly scalable, points could be mapped at the same exact position, making them indistinguishable. This type of model would be unable to adapt to new outliers nor concept drift. This paper presents a methodology to reuse an embedding to create a new one, where cluster positions are preserved. The optimization process minimizes two costs, one relative to the embedding shape and the second relative to the support embedding' match. The proposed algorithm has the same complexity than the original $t$-SNE to embed new items, and a lower one when considering the embedding of a dataset sliced into sub-pieces. The method showed promising results on a real-world dataset, allowing to observe the birth, evolution and death of clusters. The proposed approach facilitates identifying significant trends and changes, which empowers the monitoring high dimensional datasets' dynamics.


title: Nuclear charge radii of Na isotopes: A tale of two theories

abstract: The accuracy of atomic theory calculations limits the extraction of nuclear charge radii from isotope shift measurements of odd-proton nuclei. For Na isotopes, though precise spectroscopic measurements have existed since more than half a century, calculations by different methods offer a wide range of values. Here, we present accurate atomic calculations to reliably extract the Na charge radii. By combining experimental matter radii with nuclear coupled-cluster calculations based on nucleon-nucleon and three-nucleon forces, we constrain the parameters obtained from the atomic calculations. Therefore, this study guides atomic theory and highlights the importance of using accurate atomic and nuclear computations in our understanding of the size of light nuclei.


title: Awakening Latent Grounding from Pretrained Language Models for Semantic Parsing

abstract: Recent years pretrained language models (PLMs) hit a success on several downstream tasks, showing their power on modeling language. To better understand and leverage what PLMs have learned, several techniques have emerged to explore syntactic structures entailed by PLMs. However, few efforts have been made to explore grounding capabilities of PLMs, which are also essential. In this paper, we highlight the ability of PLMs to discover which token should be grounded to which concept, if combined with our proposed erasing-then-awakening approach. Empirical studies on four datasets demonstrate that our approach can awaken latent grounding which is understandable to human experts, even if it is not exposed to such labels during training. More importantly, our approach shows great potential to benefit downstream semantic parsing models. Taking text-to-SQL as a case study, we successfully couple our approach with two off-the-shelf parsers, obtaining an absolute improvement of up to 9.8%.


title: Minimax Rates for High-Dimensional Random Tessellation Forests

abstract: Random forests are a popular class of algorithms used for regression and classification. The algorithm introduced by Breiman in 2001 and many of its variants are ensembles of randomized decision trees built from axis-aligned partitions of the feature space. One such variant, called Mondrian forests, was proposed to handle the online setting and is the first class of random forests for which minimax rates were obtained in arbitrary dimension. However, the restriction to axis-aligned splits fails to capture dependencies between features, and random forests that use oblique splits have shown improved empirical performance for many tasks. In this work, we show that a large class of random forests with general split directions also achieve minimax optimal convergence rates in arbitrary dimension. This class includes STIT forests, a generalization of Mondrian forests to arbitrary split directions, as well as random forests derived from Poisson hyperplane tessellations. These are the first results showing that random forest variants with oblique splits can obtain minimax optimality in arbitrary dimension. Our proof technique relies on the novel application of the theory of stationary random tessellations in stochastic geometry to statistical learning theory.


title: $Ab$ $initio$ derivation and exact-diagonalization analysis of low-energy effective Hamiltonians for $\beta^\prime$-X[Pd(dmit)$_2$]$_2$

abstract: The molecular solids $\beta^\prime$-$X$[Pd(dmit)$_2$]$_2$ (where $X$ represents a cation) are typical compounds whose electronic structures are described by single-orbital Hubbard-type Hamiltonians with geometrical frustration. Using the $ab$ $initio$ downfolding method, we derive the low-energy effective Hamiltonians for $\beta^\prime$-$X$[Pd(dmit)$_2$]$_2$ with available room- and low-temperature structures. We find that the amplitudes of the Coulomb interactions and the anisotropy of the hopping parameters in the effective Hamiltonians are sensitive to the changes in the lattice constants induced by lowering the temperature. The obtained effective Hamiltonians are analyzed using the exact diagonalization method with the boundary-condition average. We find that a significant reduction of the antiferromagnetic ordered moment occurs in the effective Hamiltonian of $\beta^\prime$-EtMe$_3$Sb[Pd(dmit)$_2$]$_2$ with the low-temperature structure. The reduction is consistent with the quantum spin liquid behavior observed in experiments. The comprehensive derivations of the effective Hamiltonians and exact-diagonalization analyses of them will clarify the microscopic origins of the exotic quantum states of matter found in $\beta^\prime$-$X$[Pd(dmit)$_2$]$_2$ such as the quantum spin liquid behavior.


title: Critical behavior of a 2D spin-pseudospin model in a strong exchange limit

abstract: We study the 2D static spin-pseudospin model equivalent to the dilute frustrated antiferromagnetic Ising model with charge impurities. We present the results of classical Monte Carlo simulation on a square lattice with periodic boundary conditions in a strong exchange limit. In the framework of the finite-size scaling theory we obtained the static critical exponents for the specific heat $\alpha$ and the correlation length $\nu$ for a wide range of the local density-density interaction parameter $\Delta$ and charge density $n$. It was shown that the system exhibits non-universal critical behavior depending on these parameters.


title: On Hom-pre-Poisson algebras

abstract: In this paper, first we discuss Hom-pre-Poisson algebras and their relationships with Hom-Poisson algebra. Then we introduce the notion of a Hom-pre-Gerstenhaber algebra and show that a Hom-pre-Gerstenhaber algebra gives rise to a Hom-Gerstenhaber algebra. Moreover, we consider Hom-dendriform formal deformations of Hom-zinbiel algebras and show that Hom-pre-Poisson algebras are the corresponding semi-classical limits. Furthermore, we consider Hom-O-operators on Hom-Poisson algebras and study their relationships with Hom-pre-Poisson algebras. Finally, we define the notion of dual-Hom-pre-Poisson algebra and show that a Hom-average-operator on a Hom-Poisson algebra naturally gives rise to a dual-Hom-pre-Poisson algebra.


title: Spectral flow inside essential spectrum IV: $F^*F$ is a regular direction

abstract: Let~$H_0$ and~$V$ be self-adjoint operators such that~$V$ admits a factorisation $V = F^*JF$ with bounded self-adjoint $J$ and $|H_0|^{1/2}$-compact~$F.$ Flow of singular spectrum of the path of self-adjoint operators $H_0 + rV,$ $r \in \mathbb R,$ -- also called spectral flow, through a point $\lambda$ outside the essential spectrum of~$H_0$ is well studied, and appears in such diverse areas as differential geometry and condensed matter physics. Inside the essential spectrum the spectral flow through $\lambda$ for such a path is well-defined if the norm limit $$ \lim_{y \to 0^+} F (H_0 + r V - \lambda - iy)^{-1} F^* $$ exists for at least one value of the coupling variable $r \in \mathbb R$. This raises the question: given a self-adjoint operator~$H_0$ and $|H_0|^{1/2}$-compact operator $F,$ for which real numbers $\lambda$ there exists a bounded self-adjoint operator $J$ such that the limit above exists? Real numbers $\lambda$ for which this statement is true we call semi-regular and the operator $V = F^*JF$ we call a regular direction for~$H_0$ at $\lambda.$ In this paper we prove that $\lambda$ is semi-regular for~$H_0$ if and only if the direction $F^*F$ is regular.


title: Physical conditions and chemical abundances in PN M 2-36. Results from deep echelle observations

abstract: We present a spectrum of the planetary nebula M 2-36 obtained using the Ultra Violet and Visual Echelle Spectrograph (UVES) at the Very Large Telescope (VLT). 446 emission lines are detected. We perform an analysis of the chemical composition using multiple electron temperature ($T_{e}$) and density ($n_{e}$) diagnostics. $T_{e}$ and $n_{e}$ are computed using a variety of methods, including collisionally excited line (CEL) ratios, O$^{++}$ optical recombination lines (ORLs), and measuring the intensity of the Balmer jump. Besides the classical CEL abundances, we also present robust ionic abundances from ORLs of heavy elements. From CELs and ORLs of O$^{++}$, we obtain a new value for the Abundance Discrepancy Factor (ADF) of this nebula, being ADF(O$^{++})=$ 6.76 $\pm$ 0.50. From all the different line ratios that we study, we find that the object cannot be chemically homogeneous; moreover, we find that two-phased photoionization models are unable to simultaneously reproduce critical \ion{O}{ii} and [\ion{O}{iii}] line ratios. However, we find a three-phased model able to adequately reproduce such ratios. While we consider this to be a toy model, it is able to reproduce the observed temperature and density line diagnostics. Our analysis shows that it is important to study high ADF PNe with high spectral resolution, since its physical and chemical structure may be more complicated than previously thought.


title: K-AID: Enhancing Pre-trained Language Models with Domain Knowledge for Question Answering

abstract: Knowledge enhanced pre-trained language models (K-PLMs) are shown to be effective for many public tasks in the literature but few of them have been successfully applied in practice. To address this problem, we propose K-AID, a systematic approach that includes a low-cost knowledge acquisition process for acquiring domain knowledge, an effective knowledge infusion module for improving model performance, and a knowledge distillation component for reducing the model size and deploying K-PLMs on resource-restricted devices (e.g., CPU) for real-world application. Importantly, instead of capturing entity knowledge like the majority of existing K-PLMs, our approach captures relational knowledge, which contributes to better-improving sentence-level text classification and text matching tasks that play a key role in question answering (QA). We conducted a set of experiments on five text classification tasks and three text matching tasks from three domains, namely E-commerce, Government, and Film&TV, and performed online A/B tests in E-commerce. Experimental results show that our approach is able to achieve substantial improvement on sentence-level question answering tasks and bring beneficial business value in industrial settings.


title: The Eisenstein and winding elements of modular symbols for odd square-free level

abstract: We explicitly write down the Eisenstein elements inside the space of modular symbols for Eisenstein series with integer coefficients for the congruence subgroups $\Gamma_0(N)$ with $N$ odd square-free. We also compute the winding elements explicitly for these congruence subgroups. This gives an answer to a question of Merel in these cases. Our results are explicit versions of the Manin-Drinfeld Theorem [Thm. 6]. These results are the generalization of the paper [1] results to odd square-free level.


title: On the $2$-domination number of cylinders with small cycles

abstract: Domination-type parameters are difficult to manage in Cartesian product graphs and there is usually no general relationship between the parameter in both factors and in the product graph. This is the situation of the domination number, the Roman domination number or the $2$-domination number, among others. Contrary to what happens with the domination number and the Roman domination number, the $2$-domination number remains unknown in cylinders, that is, the Cartesian product of a cycle and a path and in this paper, we will compute this parameter in the cylinders with small cycles. We will develop two algorithms involving the $(\min,+)$ matrix product that will allow us to compute the desired values of $\gamma_2(C_n\Box P_m)$, with $3\leq n\leq 15$ and $m\geq 2$. We will also pose a conjecture about the general formulae for the $2$-domination number in this graph class.


title: Bell based Apostol type polynomials and its properties

abstract: Many authors studied mix type polynomials and their properties. For their numerous uses in Statistics, Combinatorial analysis and Number theory. In the present article, we define a generating function of mix type Bell based Apostol type polynomials and numbers of order a. Furthermore, we derive some elementary properties and identities of Bell based Apostol type polynomials of order a such as correlation formulas, Implicit summation formulas, derivative formulas and their special cases. Also, we derive some relation with Stirling numbers.


title: Harder's conjecture I

abstract: Let $f$ be a primitive form with respect to $SL_2(Z)$. Then we propose a conjecture on the congruence between the Klingen-Eisenstein lift of the Duke-Imamoglu-Ikeda lift of $f$ and a certain lift of a vector valued Hecke eigenform with respect to $Sp_2(Z)$. This conjecture implies Harder's conjecture. We prove the above conjecture in some cases.


title: MEPG: A Minimalist Ensemble Policy Gradient Framework for Deep Reinforcement Learning

abstract: During the training of a reinforcement learning (RL) agent, the distribution of training data is non-stationary as the agent's behavior changes over time. Therefore, there is a risk that the agent is overspecialized to a particular distribution and its performance suffers in the larger picture. Ensemble RL can mitigate this issue by learning a robust policy. However, it suffers from heavy computational resource consumption due to the newly introduced value and policy functions. In this paper, to avoid the notorious resources consumption issue, we design a novel and simple ensemble deep RL framework that integrates multiple models into a single model. Specifically, we propose the \underline{M}inimalist \underline{E}nsemble \underline{P}olicy \underline{G}radient framework (MEPG), which introduces minimalist ensemble consistent Bellman update by utilizing a modified dropout operator. MEPG holds ensemble property by keeping the dropout consistency of both sides of the Bellman equation. Additionally, the dropout operator also increases MEPG's generalization capability. Moreover, we theoretically show that the policy evaluation phase in the MEPG maintains two synchronized deep Gaussian Processes. To verify the MEPG framework's ability to generalize, we perform experiments on the gym simulator, which presents that the MEPG framework outperforms or achieves a similar level of performance as the current state-of-the-art ensemble methods and model-free methods without increasing additional computational resource costs.


title: On the Comparison of Single-Carrier vs. Digital Multi-Carrier Signaling for Long-Haul Transmission of Probabilistically Shaped Constellation Formats

abstract: We report on theoretical and experimental investigations of the nonlinear tolerance of single carrier and digital multicarrier approaches with probabilistically shaped constellations. Experimental transmission of PCS16QAM is assessed at 120 GBd over an ultra-long-haul distance.


title: On Conflict-Free Replicated Data Types and Equivocation in Byzantine Setups

abstract: We explore the property of equivocation tolerance for Conflict-Free Replicated Data Types (CRDTs). We show that a subclass of CRDTs is equivocation-tolerant and can thereby cope with any number of Byzantine faults: Without equivocation detection, prevention or remediation, they still fulfill strong eventual consistency (SEC). We also conjecture that there is only one operation-based CRDT design supporting non-commutative operations that fulfills SEC in Byzantine environments with any number of faults.


title: Two-weight inequalities for multilinear commutators in product spaces

abstract: This note is devoted to establishing two-weight estimates for commutators of singular integrals. We combine multilinearity with product spaces. A new type of two-weight extrapolation result is used to yield the quasi-Banach range of estimates.


title: Ultrasonication-Induced Extraction of Inner Shells from Double-Wall Carbon Nanotubes Characterized via In Situ Spectroscopy after Density Gradient Ultracentrifugation

abstract: Even though ultrasonication is considered to be an effective method to disperse carbon nanotubes (CNTs), its devastating effects on the nanotubes are often neglected. Here, even mild ultrasonication is found to rapidly extract the inner single-wall CNTs (SWCNTs) from the outer shells of the double-wall CNTs (DWCNTs). As-synthesized DWCNTs are gently solubilized in a surfactant solution, strictly avoiding any ultrasonication, followed by two consecutive density gradient ultracentrifugation (DGU) steps to obtain a purified colloidal solution of isolated DWCNTs. The latter is carefully selected based on in situ resonant Raman (RRS) and fluorescence (PL) spectroscopy, measured as a function of depth directly in the ultracentrifuge tube after DGU. These purified DWCNTs are ultrasonicated in successive time steps while intermittently probing the sample via RRS and PL spectroscopy. These results unravel the very fast increasing yet saturating extraction mechanism that leads to the formation of fluorescing SWCNTs. A statistical high-resolution transmission electron microscopy study confirms the drastic increase in SWCNTs after ultrasonication, and evidences that ultrasonication forms SWCNTs from both the inner and outer shells of the DWCNTs. This study demonstrates how easily ultrasonication extracts SWCNTs from individually solubilized DWCNTs, unavoidably complicating any further spectroscopic studies on DWCNTs severely.


title: A Reinforcement Learning Benchmark for Autonomous Driving in Intersection Scenarios

abstract: In recent years, control under urban intersection scenarios becomes an emerging research topic. In such scenarios, the autonomous vehicle confronts complicated situations since it must deal with the interaction with social vehicles timely while obeying the traffic rules. Generally, the autonomous vehicle is supposed to avoid collisions while pursuing better efficiency. The existing work fails to provide a framework that emphasizes the integrity of the scenarios while being able to deploy and test reinforcement learning(RL) methods. Specifically, we propose a benchmark for training and testing RL-based autonomous driving agents in complex intersection scenarios, which is called RL-CIS. Then, a set of baselines are deployed consists of various algorithms. The test benchmark and baselines are to provide a fair and comprehensive training and testing platform for the study of RL for autonomous driving in the intersection scenario, advancing the progress of RL-based methods for intersection autonomous driving control. The code of our proposed framework can be found at https://github.com/liuyuqi123/ComplexUrbanScenarios.


title: Non-log liftable log del Pezzo surfaces of rank one in characteristic five

abstract: Building upon the classification by Lacini [arXiv:2005.14544], we determine the isomorphism classes of log del Pezzo surfaces of rank one over an algebraically closed field of characteristic five either which are not log liftable over the ring of Witt vectors or whose singularities are not feasible in characteristic zero. We also show that the Kawamata-Viehweg vanishing theorem for ample $\mathbb{Z}$-Weil divisors holds for log del Pezzo surfaces of rank one in characteristic five if those singularities are feasible in characteristic zero.


title: Hierarchical Multimodal Transformer to Summarize Videos

abstract: Although video summarization has achieved tremendous success benefiting from Recurrent Neural Networks (RNN), RNN-based methods neglect the global dependencies and multi-hop relationships among video frames, which limits the performance. Transformer is an effective model to deal with this problem, and surpasses RNN-based methods in several sequence modeling tasks, such as machine translation, video captioning, \emph{etc}. Motivated by the great success of transformer and the natural structure of video (frame-shot-video), a hierarchical transformer is developed for video summarization, which can capture the dependencies among frame and shots, and summarize the video by exploiting the scene information formed by shots. Furthermore, we argue that both the audio and visual information are essential for the video summarization task. To integrate the two kinds of information, they are encoded in a two-stream scheme, and a multimodal fusion mechanism is developed based on the hierarchical transformer. In this paper, the proposed method is denoted as Hierarchical Multimodal Transformer (HMT). Practically, extensive experiments show that HMT surpasses most of the traditional, RNN-based and attention-based video summarization methods.


title: Why Don't You Click: Neural Correlates of Non-Click Behaviors in Web Search

abstract: Web search heavily relies on click-through behavior as an essential feedback signal for performance improvement and evaluation. Traditionally, click is usually treated as a positive implicit feedback signal of relevance or usefulness, while non-click (especially non-click after examination) is regarded as a signal of irrelevance or uselessness. However, there are many cases where users do not click on any search results but still satisfy their information need with the contents of the results shown on the Search Engine Result Page (SERP). This raises the problem of measuring result usefulness and modeling user satisfaction in "Zero-click" search scenarios. Previous works have solved this issue by (1) detecting user satisfaction for abandoned SERP with context information and (2) considering result-level click necessity with external assessors' annotations. However, few works have investigated the reason behind non-click behavior and estimated the usefulness of non-click results. A challenge for this research question is how to collect valuable feedback for non-click results. With neuroimaging technologies, we design a lab-based user study and reveal differences in brain signals while examining non-click search results with different usefulness levels. The findings in significant brain regions and electroencephalogram~(EEG) spectrum also suggest that the process of usefulness judgment might involve similar cognitive functions of relevance perception and satisfaction decoding. Inspired by these findings, we conduct supervised learning tasks to estimate the usefulness of non-click results with brain signals and conventional information (i.e., content and context factors). Results show that it is feasible to utilize brain signals to improve usefulness estimation performance and enhancing human-computer interactions in "Zero-click" search scenarios.


title: A Few-Shot Learning Approach for Sound Source Distance Estimation Using Relation Networks

abstract: In this paper, we study the performance of few-shot learning, specifically meta learning empowered few-shot relation networks, over supervised deep learning and conventional machine learning approaches in the problem of Sound Source Distance Estimation (SSDE). In previous research on deep supervised SSDE, low accuracies have often resulted from the mismatch between the training data (from known environments) and the test data (from unknown environments). By performing comparative experiments on a sufficient amount of data, we show that the few-shot relation network outperforms other competitors including eXtreme Gradient Boosting (XGBoost), Support Vector Machine (SVM), Convolutional Neural Network (CNN), and MultiLayer Perceptron (MLP). Hence it is possible to calibrate a microphone-equipped system, with a few labeled samples of audio recorded in a particular unknown environment to adjust and generalize our classifier to the possible input data and gain higher accuracies.


title: Critical properties of a 2D frustrated magnet with non-magnetic impurities

abstract: We report on classical Monte Carlo study of phase transitions and critical behavior of a 2D spin-pseudospin model describing a dilute magnet with competing charge and spin interactions. The static critical exponents of the specific heat and correlation length are calculated using the finite-size scaling theory in a wide range of model parameters. The order of phase transitions is analyzed within the energy histogram method. It is found that approaching the frustration point and increasing the density of non-magnetic impurities leads to non-universal critical behavior and first-order phase transitions. Features of non-universal critical behavior are shown to depend on the relationship between the parameters of the spin and pseudospin interactions.


title: Improving 360 Monocular Depth Estimation via Non-local Dense Prediction Transformer and Joint Supervised and Self-supervised Learning

abstract: Due to difficulties in acquiring ground truth depth of equirectangular (360) images, the quality and quantity of equirectangular depth data today is insufficient to represent the various scenes in the world. Therefore, 360 depth estimation studies, which relied solely on supervised learning, are destined to produce unsatisfactory results. Although self-supervised learning methods focusing on equirectangular images (EIs) are introduced, they often have incorrect or non-unique solutions, causing unstable performance. In this paper, we propose 360 monocular depth estimation methods which improve on the areas that limited previous studies. First, we introduce a self-supervised 360 depth learning method that only utilizes gravity-aligned videos, which has the potential to eliminate the needs for depth data during the training procedure. Second, we propose a joint learning scheme realized by combining supervised and self-supervised learning. The weakness of each learning is compensated, thus leading to more accurate depth estimation. Third, we propose a non-local fusion block, which can further retain the global information encoded by vision transformer when reconstructing the depths. With the proposed methods, we successfully apply the transformer to 360 depth estimations, to the best of our knowledge, which has not been tried before. On several benchmarks, our approach achieves significant improvements over previous works and establishes a state of the art.


title: Unique continuation for the heat operator with potentials in weak spaces

abstract: We prove strong unique continuation property for the differential inequality $|(\partial_t +\Delta)u(x,t)|\le V(x,t)|u(x,t)|$ with $V$ contained in weak spaces. In particular, we establish the strong unique continuation property for $V\in L^\infty_t L^{d/2,\infty}_x$, which has been left open since the works of Escauriaza [6] and Escauriaza-Vega [8]. Our results are consequences of the Carleman estimates for the heat operator in the Lorentz spaces.


title: Energy Scale Deformation on Regular Polyhedra

abstract: A variant of energy scale deformation is considered for the S = 1/2 antiferromagnetic Heisenberg model on polyhedra. The deformation is induced by the perturbations to the uniform Hamiltonian, whose coefficients are determined by the bond coordinates. On the tetrahedral, octahedral, and cubic clusters, the perturbative terms do not affect the ground state of the uniform Hamiltonian when they are sufficiently small. On the other hand, for the icosahedral and dodecahedral clusters, it is numerically confirmed that the ground state of the uniform Hamiltonian is almost insensitive to the perturbations unless they lead to a discontinuous change in the ground state. The obtained results suggest the existence of a generalization of sine-square deformation in higher dimensions.