title: Online Probabilistic Model Identification using Adaptive Recursive MCMC

abstract: Although the Bayesian paradigm offers a formal framework for estimating the entire probability distribution over uncertain parameters, its online implementation can be challenging due to high computational costs. We suggest the Adaptive Recursive Markov Chain Monte Carlo (ARMCMC) method, which eliminates the shortcomings of conventional online techniques while computing the entire probability density function of model parameters. The limitations to Gaussian noise, the application to only linear in the parameters (LIP) systems, and the persistent excitation (PE) needs are some of these drawbacks. In ARMCMC, a temporal forgetting factor (TFF)-based variable jump distribution is proposed. The forgetting factor can be presented adaptively using the TFF in many dynamical systems as an alternative to a constant hyperparameter. By offering a trade-off between exploitation and exploration, the specific jump distribution has been optimised towards hybrid/multi-modal systems that permit inferences among modes. These trade-off are adjusted based on parameter evolution rate. We demonstrate that ARMCMC requires fewer samples than conventional MCMC methods to achieve the same precision and reliability. We demonstrate our approach using parameter estimation in a soft bending actuator and the Hunt-Crossley dynamic model, two challenging hybrid/multi-modal benchmarks. Additionally, we compare our method with recursive least squares and the particle filter, and show that our technique has significantly more accurate point estimates as well as a decrease in tracking error of the value of interest.


title: DMODE: Differential Monocular Object Distance Estimation Module without Class Specific Information

abstract: Utilizing a single camera for measuring object distances is a cost-effective alternative to stereo-vision and LiDAR. Although monocular distance estimation has been explored in the literature, most existing techniques rely on object class knowledge to achieve high performance. Without this contextual data, monocular distance estimation becomes more challenging, lacking reference points and object-specific cues. However, these cues can be misleading for objects with wide-range variation or adversarial situations, which is a challenging aspect of object-agnostic distance estimation. In this paper, we propose DMODE, a class-agnostic method for monocular distance estimation that does not require object class knowledge. DMODE estimates an object's distance by fusing its fluctuation in size over time with the camera's motion, making it adaptable to various object detectors and unknown objects, thus addressing these challenges. We evaluate our model on the KITTI MOTS dataset using ground-truth bounding box annotations and outputs from TrackRCNN and EagerMOT. The object's location is determined using the change in bounding box sizes and camera position without measuring the object's detection source or class attributes. Our approach demonstrates superior performance in multi-class object distance detection scenarios compared to conventional methods.


title: Hunting for an EMC-like effect for antiquarks

abstract: We argue that the Drell-Yan process in the $x_A \ge 0.15$ kinematics recently studied at FNAL by the E906/SeaQuest experiment may allow to observe an analogous of the EMC effect for antiquarks. The effects of Fermi motion and energy loss are considered. The preliminary E906/SeaQuest data are inconsistent with the growth of the $\sigma_A/A\sigma_N$ ratio expected in the Fermi motion scenario at $x_A \ge 0.25$. The pattern of the $x_A$ dependence of the ratio seems also inconsistent with a scenario in which the dominant nuclear effect is a suppression of the cross section due to the energy loss experienced by a quark of the projectile proton involved in the Drell-Yan process. All together the data suggest the possibility of a modification of the antiquark parton distributions in nuclei, with a pattern similar to the one observed in the EMC effect. We argue that optimal kinematics to look for an antiquark EMC-like effect would be to measure the $\sigma_A^{DY}/A\sigma_N^{DY}$ ratios for $x_A$ = 0.2-0.4 and $x_p$ $\approx$ constant.


title: GANI: Global Attacks on Graph Neural Networks via Imperceptible Node Injections

abstract: Graph neural networks (GNNs) have found successful applications in various graph-related tasks. However, recent studies have shown that many GNNs are vulnerable to adversarial attacks. In a vast majority of existing studies, adversarial attacks on GNNs are launched via direct modification of the original graph such as adding/removing links, which may not be applicable in practice. In this paper, we focus on a realistic attack operation via injecting fake nodes. The proposed Global Attack strategy via Node Injection (GANI) is designed under the comprehensive consideration of an unnoticeable perturbation setting from both structure and feature domains. Specifically, to make the node injections as imperceptible and effective as possible, we propose a sampling operation to determine the degree of the newly injected nodes, and then generate features and select neighbors for these injected nodes based on the statistical information of features and evolutionary perturbations obtained from a genetic algorithm, respectively. In particular, the proposed feature generation mechanism is suitable for both binary and continuous node features. Extensive experimental results on benchmark datasets against both general and defended GNNs show strong attack performance of GANI. Moreover, the imperceptibility analyses also demonstrate that GANI achieves a relatively unnoticeable injection on benchmark datasets.


title: Transformers For Recognition In Overhead Imagery: A Reality Check

abstract: There is evidence that transformers offer state-of-the-art recognition performance on tasks involving overhead imagery (e.g., satellite imagery). However, it is difficult to make unbiased empirical comparisons between competing deep learning models, making it unclear whether, and to what extent, transformer-based models are beneficial. In this paper we systematically compare the impact of adding transformer structures into state-of-the-art segmentation models for overhead imagery. Each model is given a similar budget of free parameters, and their hyperparameters are optimized using Bayesian Optimization with a fixed quantity of data and computation time. We conduct our experiments with a large and diverse dataset comprising two large public benchmarks: Inria and DeepGlobe. We perform additional ablation studies to explore the impact of specific transformer-based modeling choices. Our results suggest that transformers provide consistent, but modest, performance improvements. We only observe this advantage however in hybrid models that combine convolutional and transformer-based structures, while fully transformer-based models achieve relatively poor performance.


title: Free Electrons Holes and Novel Surface Polar Order in Tetragonal BaTiO3 Ground States

abstract: We find novel polar orders that yield electron (e-) and hole (h+) gas and depend on surface terminations, using density functional theory (DFT) that, unlike existing reports, relaxed all the ion positions of ATiO3 having spontaneous polarization Ps (A: alkali earth metal). By the experiments of atomic-oxygen cleaned surfaces of BaTiO3, we find both e- and h+ gas that are proven to originate from Ps and constrain electrostatic potential, which has been missing. These experiments that remarkably agree with the DFTs of defect free BaTiO3 reveal the properties of Ps-originated e-h+ and, for ferroelectric basics, an e-h+-posed intrinsic constraint on depolarization field arising from Ps in proper time ranges.


title: Sublinear-Time Algorithms for Max Cut, Max E2Lin$(q)$, and Unique Label Cover on Expanders

abstract: We show sublinear-time algorithms for Max Cut and Max E2Lin$(q)$ on expanders in the adjacency list model that distinguishes instances with the optimal value more than $1-\varepsilon$ from those with the optimal value less than $1-\rho$ for $\rho \gg \varepsilon$. The time complexities for Max Cut and Max $2$Lin$(q)$ are $\widetilde{O}(\frac{1}{\phi^2\rho} \cdot m^{1/2+O(\varepsilon/(\phi^2\rho))})$ and $\widetilde{O}(\mathrm{poly}(\frac{q}{\phi\rho})\cdot {(mq)}^{1/2+O(q^6\varepsilon/\phi^2\rho^2)})$, respectively, where $m$ is the number of edges in the underlying graph and $\phi$ is its conductance. Then, we show a sublinear-time algorithm for Unique Label Cover on expanders with $\phi \gg \epsilon$ in the bounded-degree model. The time complexity of our algorithm is $\widetilde{O}_d(2^{q^{O(1)}\cdot\phi^{1/q}\cdot \varepsilon^{-1/2}}\cdot n^{1/2+q^{O(q)}\cdot \varepsilon^{4^{1.5-q}}\cdot \phi^{-2}})$, where $n$ is the number of variables. We complement these algorithmic results by showing that testing $3$-colorability requires $\Omega(n)$ queries even on expanders.


title: Neutron Production in The Scattering S250 Mevion Proton-Therapy System

abstract: Secondary radiation in a radiation therapy environment is considered a cause for post-treatment side effects including secondary carcinogenesis. In a proton-therapy setup, neutrons deliver a considerable extra dose to the patient. Various measurements and calculations of neutron dose suggest a wide range of values for this quantity. This paper provides a comparison between the previously published values and analyzes the Monte Carlo calculated neutron dose from the present work using the neutron cross-section data. The purpose is to provide a range for the convergence of several neutron-absorbed dose data points (e.g. 3.94 mSv/Gy in a Bonner sphere measurement and 0.4 mSv/Gy in a SWENDI measurement) in previous works of other authors.


title: XSLIDE (X-Ray Spectral Line IDentifier and Explorer): a quick-look tool for XRISM

abstract: We present XSLIDE (X-Ray Spectral Line IDentifier and Explorer), a graphical user interface that has been designed as a quick-look tool for the upcoming X-Ray Imaging and Spectroscopy Mission (XRISM). XSLIDE is a simple and user-friendly application that allows for the interactive plotting of spectra from XRISM's Resolve instrument without requiring the selection of models for forward-fitting. XSLIDE performs common tasks such as rebinning, continuum fitting, automatically detecting lines, assigning detected lines to known atomic transitions, spectral diagnostics, and more. It is expected that XSLIDE will allow XRISM's scientific investigators to rapidly examine many spectra to find those which contain spectral lines of particular interest, and it will also allow astronomers from outside the field of high-resolution X-ray spectroscopy to easily interact with XRISM data.


title: Qualitative analysis for Moser-Trudinger nonlinearities with a low energy

abstract: We are concerned with the Moser-Trudinger problem \begin{equation*} \begin{cases} -\Delta u=\lambda ue^{u^2}~~&\mbox{in}~\Omega,\\[0.5mm] u>0 ~~ &{\text{in}~\Omega},\\[0.5mm] u=0~~&\mbox{on}~\partial \Omega, \end{cases} \end{equation*} where $\Omega \subset \mathbb{R}^2$ is a smooth bounded domain and $\lambda>0$ is sufficiently small. Qualitative analysis for Moser-Trudinger nonlinearities has been studied in recent decades, however there is still a lot of clarity about this issue, even for a low energy. The reason is that this problem is a critical exponent for dimension two and will lose compactness. Here by using a variety of local Pohozaev identities, we qualitatively analyze the positive solutions of Moser-Trudinger problem with a low energy, which contains the Morse index, non-degeneracy, asymptotic behavior, uniqueness and symmetry of solutions. Since the fundamental solution of $-\Delta$ in $\Omega \subset \mathbb{R}^2$ is in logarithmic form and the corresponding bubble is exponential growth, more precise asymptotic behavior of the solutions is needed, which is of independent interest. Moreover, to obtain our results, some ODE's theory will be used to a prior estimate of the solutions and some elliptic theory in dimension two will play a crucial role.


title: Keep CALM and CRDT On

abstract: Despite decades of research and practical experience, developers have few tools for programming reliable distributed applications without resorting to expensive coordination techniques. Conflict-free replicated datatypes (CRDTs) are a promising line of work that enable coordination-free replication and offer certain eventual consistency guarantees in a relatively simple object-oriented API. Yet CRDT guarantees extend only to data updates; observations of CRDT state are unconstrained and unsafe. We propose an agenda that embraces the simplicity of CRDTs, but provides richer, more uniform guarantees. We extend CRDTs with a query model that reasons about which queries are safe without coordination by applying monotonicity results from the CALM Theorem, and lay out a larger agenda for developing CRDT data stores that let developers safely and efficiently interact with replicated application state.


title: Nash Equilibria and Pitfalls of Adversarial Training in Adversarial Robustness Games

abstract: Adversarial training is a standard technique for training adversarially robust models. In this paper, we study adversarial training as an alternating best-response strategy in a 2-player zero-sum game. We prove that even in a simple scenario of a linear classifier and a statistical model that abstracts robust vs. non-robust features, the alternating best response strategy of such game may not converge. On the other hand, a unique pure Nash equilibrium of the game exists and is provably robust. We support our theoretical results with experiments, showing the non-convergence of adversarial training and the robustness of Nash equilibrium.


title: Learning to Perform Complex Tasks through Compositional Fine-Tuning of Language Models

abstract: How to usefully encode compositional task structure has long been a core challenge in AI. Recent work in chain of thought prompting has shown that for very large neural language models (LMs), explicitly demonstrating the inferential steps involved in a target task may improve performance over end-to-end learning that focuses on the target task alone. However, chain of thought prompting has significant limitations due to its dependency on huge pretrained LMs. In this work, we present compositional fine-tuning (CFT): an approach based on explicitly decomposing a target task into component tasks, and then fine-tuning smaller LMs on a curriculum of such component tasks. We apply CFT to recommendation tasks in two domains, world travel and local dining, as well as a previously studied inferential task (sports understanding). We show that CFT outperforms end-to-end learning even with equal amounts of data, and gets consistently better as more component tasks are modeled via fine-tuning. Compared with chain of thought prompting, CFT performs at least as well using LMs only 7.4% of the size, and is moreover applicable to task domains for which data are not available during pretraining.


title: Tunable Localized Charge Transfer Excitons in a Mixed Dimensional van der Waals Heterostructure

abstract: Observation of interlayer, charge-transfer (CT) excitons in van der Waals heterostructures (vdWHs) based on 2D-2D systems has been well investigated. While conceptually interesting, these charge transfer excitons are highly delocalized and spatially localizing them requires twisting layers at very specific angles. This issue of localizing the CT excitons can be overcome via making mixed dimensional vdWHs (MDHs) where one of the components is a spatially quantum confined medium. Here, we demonstrate the formation of CT excitons in a 2D/quasi-2D system comprising MoSe2 and WSe2 monolayers and CdSe/CdS based core/shell nanoplates (NPLs). Spectral signatures of CT excitons in our MDHs were resolved locally at the 2D/single-NPL heterointerface using tip-enhanced photoluminescence (TEPL) at room temperature. By varying both the 2D material, the shell thickness of the NPLs, and applying out-of-plane electric field, the exciton resonance energy was tuned by up to 120 meV. Our finding is a significant step towards the realization of highly tunable MDH-based next generation photonic devices.

categories: cond-mat.mes-hall physics.app-ph physics.optics quant-ph


title: Blockchain and Machine Learning for Fraud Detection: A Privacy-Preserving and Adaptive Incentive Based Approach

abstract: Financial fraud cases are on the rise even with the current technological advancements. Due to the lack of inter-organization synergy and because of privacy concerns, authentic financial transaction data is rarely available. On the other hand, data-driven technologies like machine learning need authentic data to perform precisely in real-world systems. This study proposes a blockchain and smart contract-based approach to achieve robust Machine Learning (ML) algorithm for e-commerce fraud detection by facilitating inter-organizational collaboration. The proposed method uses blockchain to secure the privacy of the data. Smart contract deployed inside the network fully automates the system. An ML model is incrementally upgraded from collaborative data provided by the organizations connected to the blockchain. To incentivize the organizations, we have introduced an incentive mechanism that is adaptive to the difficulty level in updating a model. The organizations receive incentives based on the difficulty faced in updating the ML model. A mining criterion has been proposed to mine the block efficiently. And finally, the blockchain network istested under different difficulty levels and under different volumes of data to test its efficiency. The model achieved 98.93% testing accuracy and 98.22% Fbeta score (recall-biased f measure) over eight incremental updates. Our experiment shows that both data volume and difficulty level of blockchain impacts the mining time. For difficulty level less than five, mining time and difficulty level has a positive correlation. For difficulty level two and three, less than a second is required to mine a block in our system. Difficulty level five poses much more difficulties to mine the blocks.


title: Partially Trusting the Service Mesh Control Plane

abstract: Zero Trust is a novel cybersecurity model that focuses on continually evaluating trust to prevent the initiation and horizontal spreading of attacks. A cloud-native Service Mesh is an example of Zero Trust Architecture that can filter out external threats. However, the Service Mesh does not shield the Application Owner from internal threats, such as a rogue administrator of the cluster where their application is deployed. In this work, we are enhancing the Service Mesh to allow the definition and reinforcement of a Verifiable Configuration that is defined and signed off by the Application Owner. Backed by automated digital signing solutions and confidential computing technologies, the Verifiable Configuration allows changing the trust model of the Service Mesh, from the data plane fully trusting the control plane to partially trusting it. This lets the application benefit from all the functions provided by the Service Mesh (resource discovery, traffic management, mutual authentication, access control, observability), while ensuring that the Cluster Administrator cannot change the state of the application in a way that was not intended by the Application Owner.


title: Differential Operators, Gauges, and Mixed Hodge Modules

abstract: The purpose of this paper is to develop a new theory of gauges in mixed characteristic. Namely, let $k$ be a perfect field of characteristic $p>0$ and $W(k)$ the $p$-typical Witt vectors. Making use of Berthelot's arithmetic differential operators, we define for a smooth formal scheme $\mathfrak{X}$ over $W(k)$, a new sheaf of algebras $\widehat{\mathcal{D}}_{\mathfrak{X}}^{(0,1)}$ which can be considered a higher dimensional analogue of the (commutative) Dieudonne ring. Modules over this sheaf of algebras can be considered the analogue (over $\mathfrak{X}$) of the gauges of Ekedahl and Fontain-Jannsen. We show that modules over $\widehat{\mathcal{D}}_{\mathfrak{X}}^{(0,1)}$ admit all of the usual $\mathcal{D}$-module operations, and we prove a robust generalization of Mazur's theorem in this context. Finally, we show that an integral form of a mixed Hodge module of geometric origin admits, after a suitable $p$-adic completion, the structure of a module over $\widehat{\mathcal{D}}_{\mathfrak{X}}^{(0,1)}$. This allows us to prove a version of Mazur's theorem for the intersection cohomology and the ordinary cohomology of an arbitrary quasiprojective variety defined over a number field.


title: Pufferfish Privacy: An Information-Theoretic Study

abstract: Pufferfish privacy (PP) is a generalization of differential privacy (DP), that offers flexibility in specifying sensitive information and integrates domain knowledge into the privacy definition. Inspired by the illuminating formulation of DP in terms of mutual information due to Cuff and Yu, this work explores PP through the lens of information theory. We provide an information-theoretic formulation of PP, termed mutual information PP (MI PP), in terms of the conditional mutual information between the mechanism and the secret, given the public information. We show that MI PP is implied by the regular PP and characterize conditions under which the reverse implication is also true, recovering the relationship between DP and its information-theoretic variant as a special case. We establish convexity, composability, and post-processing properties for MI PP mechanisms and derive noise levels for the Gaussian and Laplace mechanisms. The obtained mechanisms are applicable under relaxed assumptions and provide improved noise levels in some regimes. Lastly, applications to auditing privacy frameworks, statistical inference tasks, and algorithm stability are explored.


title: Towards Energy-Efficient, Low-Latency and Accurate Spiking LSTMs

abstract: Spiking Neural Networks (SNNs) have emerged as an attractive spatio-temporal computing paradigm for complex vision tasks. However, most existing works yield models that require many time steps and do not leverage the inherent temporal dynamics of spiking neural networks, even for sequential tasks. Motivated by this observation, we propose an \rev{optimized spiking long short-term memory networks (LSTM) training framework that involves a novel ANN-to-SNN conversion framework, followed by SNN training}. In particular, we propose novel activation functions in the source LSTM architecture and judiciously select a subset of them for conversion to integrate-and-fire (IF) activations with optimal bias shifts. Additionally, we derive the leaky-integrate-and-fire (LIF) activation functions converted from their non-spiking LSTM counterparts which justifies the need to jointly optimize the weights, threshold, and leak parameter. We also propose a pipelined parallel processing scheme which hides the SNN time steps, significantly improving system latency, especially for long sequences. The resulting SNNs have high activation sparsity and require only accumulate operations (AC), in contrast to expensive multiply-and-accumulates (MAC) needed for ANNs, except for the input layer when using direct encoding, yielding significant improvements in energy efficiency. We evaluate our framework on sequential learning tasks including temporal MNIST, Google Speech Commands (GSC), and UCI Smartphone datasets on different LSTM architectures. We obtain test accuracy of 94.75% with only 2 time steps with direct encoding on the GSC dataset with 4.1x lower energy than an iso-architecture standard LSTM.


title: A Solution to Slosh-free Robot Trajectory Optimization

abstract: This paper is about fast slosh free fluid transportation. Existing approaches are either computationally heavy or only suitable for specific robots and container shapes. We model the end effector as a point mass suspended by a spherical pendulum and study the requirements for slosh free motion and the validity of the point mass model. In this approach, slosh free trajectories are generated by controlling the pendulum's pivot and simulating the motion of the point mass. We cast the trajectory optimization problem as a quadratic program; this strategy can be used to obtain valid control inputs. Through simulations and experiments on a 7 DoF Franka Emika Panda robot we validate the effectiveness of the proposed approach.


title: Constrained large solutions to Leray's problem in a distorted strip with the Navier-slip boundary condition

abstract: In this paper, we will solve the Leray's problem for the stationary Navier-Stokes system in a 2D infinite distorted strip with the Navier-slip boundary condition. The existence, uniqueness, regularity and asymptotic behavior of the solution will be investigated. Moreover, we discuss how the friction coefficient affects the well-posedness of the solution. Due to the validity of the Korn's inequality, all constants in each a priori estimate are independent of the friction coefficient. The main novelty is the total flux of the velocity can be relatively large (proportional to the {\it slip length}) when the friction coefficient of the Navier-slip boundary condition is small, which is essentially different from the 3D case.


title: Phenomenology of earthquakes

abstract: Phenomenology is the unity of principles and methods of studying the essence of phenomena. This paper is a concise review of recent works in which the phenomenological ideas of physics are used to analyze earthquakes. An example of a phenomenological theory is thermodynamics. Maxwell's electrodynamics is also a perfect example of a phenomenological theory. The phenomenology of earthquakes has not yet reached such a level. So far, we have reached the status of prolegomena for the future phenomenology of earthquakes. The current state can be characterized as preliminary. Nevertheless, in this paper, using specific examples, it is shown that when searching for the foundations of a theory, when processing and analyzing specific manifestations of seismicity, it is useful to use phenomenological concepts of general physics. Keywords: geodynamics, Omori law, Batth law, master equation, deactivation factor, inverse problem, proper time, global seismicity, waiting time, triggers, triad of earthquakes, self-oscillations of the Earth.


title: Modal-specific Pseudo Query Generation for Video Corpus Moment Retrieval

abstract: Video corpus moment retrieval (VCMR) is the task to retrieve the most relevant video moment from a large video corpus using a natural language query. For narrative videos, e.g., dramas or movies, the holistic understanding of temporal dynamics and multimodal reasoning is crucial. Previous works have shown promising results; however, they relied on the expensive query annotations for VCMR, i.e., the corresponding moment intervals. To overcome this problem, we propose a self-supervised learning framework: Modal-specific Pseudo Query Generation Network (MPGN). First, MPGN selects candidate temporal moments via subtitle-based moment sampling. Then, it generates pseudo queries exploiting both visual and textual information from the selected temporal moments. Through the multimodal information in the pseudo queries, we show that MPGN successfully learns to localize the video corpus moment without any explicit annotation. We validate the effectiveness of MPGN on the TVR dataset, showing competitive results compared with both supervised models and unsupervised setting models.


title: Estimating probabilities of multivariate failure sets based on pairwise tail dependence coefficients

abstract: An important problem in extreme-value theory is the estimation of the probability that a high-dimensional random vector falls into a given extreme failure set. This paper provides a parametric approach to this problem, based on a generalization of the tail pairwise dependence matrix (TPDM). The TPDM gives a partial summary of tail dependence for all pairs of components of the random vector. We propose an algorithm to obtain an approximate completely positive decomposition of the TPDM. The decomposition is easy to compute and applicable to moderate to high dimensions. Based on the decomposition, we obtain parameters estimates of a max-linear model whose TPDM is equal to that of the original random vector. We apply the proposed decomposition algorithm to industry portfolio returns and maximal wind speeds to illustrate its applicability.


title: Conformal Predictor for Improving Zero-shot Text Classification Efficiency

abstract: Pre-trained language models (PLMs) have been shown effective for zero-shot (0shot) text classification. 0shot models based on natural language inference (NLI) and next sentence prediction (NSP) employ cross-encoder architecture and infer by making a forward pass through the model for each label-text pair separately. This increases the computational cost to make inferences linearly in the number of labels. In this work, we improve the efficiency of such cross-encoder-based 0shot models by restricting the number of likely labels using another fast base classifier-based conformal predictor (CP) calibrated on samples labeled by the 0shot model. Since a CP generates prediction sets with coverage guarantees, it reduces the number of target labels without excluding the most probable label based on the 0shot model. We experiment with three intent and two topic classification datasets. With a suitable CP for each dataset, we reduce the average inference time for NLI- and NSP-based models by 25.6% and 22.2% respectively, without dropping performance below the predefined error rate of 1%.


title: Computational Fluid Dynamics (CFD) analysis of mixed convection heat transfer enhancement in a channel with complex rotating obstruction

abstract: In this thesis, a variable speed heat conducting cylinder is positioned in the middle of a rectangular channel with an active flow modification system to demonstrate a numerical study of steady two-dimensional mixed convention heat transfer phenomena. In the current study, the lower wall has a discrete isoflux heater installed while the upper wall is kept at an isothermal low temperature. The Prandtl number of air passing through the channel is held constant at 0.71 while the Reynolds and Grashof numbers are greatly varied for four different cylinder configurations, including (a) channels without cylinders, (b) channels with stationary cylinders, (c) channels with rotating clockwise cylinders, and (d) channels with rotating counterclockwise cylinders. Only the clockwise and counterclockwise rotational setups have a speed ratio variation of 0.5, 1.0, and 1.5. The distribution of streamlines and isothermal lines are used to evaluate the impact on the flow pattern and temperature field, while the local and surface averaged Nusselt numbers are used to analyze the impact on the heat transfer phenomena. The findings show that the Grashof and Reynolds numbers, rotational speed, and cylinder configuration have a significant impact on the flow pattern, temperature field, and heat transfer characteristics.


title: Development of a Hybrid Simulation and Experiment Test Platform for Dynamic Positioning Vessels

abstract: The harsh ocean environment and complex operating condition require high dynamic positioning (DP) capability of offshore vessel. The design, development and performance evaluation of DP system are generally carried out by numerical simulations or scale model experiments. Compared with the time-consuming and laborious experiment, the simulation is convenient and low cost, but its results lack practical reference due to oversimplification of the model. Therefore, this paper presents a hybrid simulation and experiment test platform for DP vessels. Its characteristics are: the realistic calculation of environmental loads and motion response, the consistency of algorithms and parameters for simulation and experiment greatly shortening the time of experiment adjusting, switchable and online renewable controller facilitating algorithm testing. The test platform can test the performance of DP system and determine the operational time window. In the hydrodynamic simulation, the six degree-of-freedom model is used to describe the dynamic response of the DP vessel, considering the fluid memory effect and frequency-dependent hydrodynamic parameters. In the experiment, the similarity theory based on the same Froude number is used to ensure the consistency of control parameters with simulation. Finally, a case study of DP shuttle tanker is used to verify the credibility of the test platform.


title: Facial De-occlusion Network for Virtual Telepresence Systems

abstract: To see what is not in the image is one of the broader missions of computer vision. Technology to inpaint images has made significant progress with the coming of deep learning. This paper proposes a method to tackle occlusion specific to human faces. Virtual presence is a promising direction in communication and recreation for the future. However, Virtual Reality (VR) headsets occlude a significant portion of the face, hindering the photo-realistic appearance of the face in the virtual world. State-of-the-art image inpainting methods for de-occluding the eye region does not give usable results. To this end, we propose a working solution that gives usable results to tackle this problem enabling the use of the real-time photo-realistic de-occluded face of the user in VR settings.


title: Model and Data Transfer for Cross-Lingual Sequence Labelling in Zero-Resource Settings

abstract: Zero-resource cross-lingual transfer approaches aim to apply supervised models from a source language to unlabelled target languages. In this paper we perform an in-depth study of the two main techniques employed so far for cross-lingual zero-resource sequence labelling, based either on data or model transfer. Although previous research has proposed translation and annotation projection (data-based cross-lingual transfer) as an effective technique for cross-lingual sequence labelling, in this paper we experimentally demonstrate that high capacity multilingual language models applied in a zero-shot (model-based cross-lingual transfer) setting consistently outperform data-based cross-lingual transfer approaches. A detailed analysis of our results suggests that this might be due to important differences in language use. More specifically, machine translation often generates a textual signal which is different to what the models are exposed to when using gold standard data, which affects both the fine-tuning and evaluation processes. Our results also indicate that data-based cross-lingual transfer approaches remain a competitive option when high-capacity multilingual language models are not available.


title: Mitigating Gradient Bias in Multi-objective Learning: A Provably Convergent Stochastic Approach

abstract: Machine learning problems with multiple objective functions appear either in learning with multiple criteria where learning has to make a trade-off between multiple performance metrics such as fairness, safety and accuracy; or, in multi-task learning where multiple tasks are optimized jointly, sharing inductive bias between them. This problems are often tackled by the multi-objective optimization framework. However, existing stochastic multi-objective gradient methods and its variants (e.g., MGDA, PCGrad, CAGrad, etc.) all adopt a biased noisy gradient direction, which leads to degraded empirical performance. To this end, we develop a stochastic Multi-objective gradient Correction (MoCo) method for multi-objective optimization. The unique feature of our method is that it can guarantee convergence without increasing the batch size even in the non-convex setting. Simulations on multi-task supervised and reinforcement learning demonstrate the effectiveness of our method relative to state-of-the-art methods.


title: Fast Beam Alignment via Pure Exploration in Multi-armed Bandits

abstract: The beam alignment (BA) problem consists in accurately aligning the transmitter and receiver beams to establish a reliable communication link in wireless communication systems. Existing BA methods search the entire beam space to identify the optimal transmit-receive beam pair. This incurs a significant latency when the number of antennas is large. In this work, we develop a bandit-based fast BA algorithm to reduce BA latency for millimeter-wave (mmWave) communications. Our algorithm is named Two-Phase Heteroscedastic Track-and-Stop (2PHT\&S). We first formulate the BA problem as a pure exploration problem in multi-armed bandits in which the objective is to minimize the required number of time steps given a certain fixed confidence level. By taking advantage of the correlation structure among beams that the information from nearby beams is similar and the heteroscedastic property that the variance of the reward of an arm (beam) is related to its mean, the proposed algorithm groups all beams into several beam sets such that the optimal beam set is first selected and the optimal beam is identified in this set after that. Theoretical analysis and simulation results on synthetic and semi-practical channel data demonstrate the clear superiority of the proposed algorithm vis-\`a-vis other baseline competitors.


title: Bounded Palais-Smale sequences with Morse type information for some constrained functionals

abstract: In this paper, we study, for functionals having a mountain pass geometry on a constraint, the existence of bounded Palais-Smale sequences carrying Morse index type information.


title: The observation of quantum fluctuations in a kagome Heisenberg antiferromagnet

abstract: The search for the experimental evidence of quantum spin liquid (QSL) states is critical but extremely challenging, as the quenched interaction randomness introduced by structural imperfection is usually inevitable in real materials. YCu$_3$(OH)$_{6.5}$Br$_{2.5}$ (YCOB) is a spin-1/2 kagome Heisenberg antiferromagnet (KHA) with strong coupling of $\langle J_1\rangle\sim$ 51 K but without conventional magnetic freezing down to 50 mK $\sim$ 0.001$\langle J_1\rangle$. Here, we report a Br nuclear magnetic resonance (NMR) study of the local spin susceptibility and dynamics on the single crystal of YCOB. The temperature dependence of NMR main-line shifts and broadening can be well understood within the frame of the KHA model with randomly distributed hexagons of alternate exchanges, compatible with the formation of a randomness-induced QSL state at low temperatures. The in-plane spin fluctuations as measured by the spin-lattice relaxation rates ($1/T_1$) exhibit a weak temperature dependence down to $T$ $\sim$ 0.03$\langle J_1\rangle$. Our results demonstrate that the majority of spins remain highly fluctuating at low temperatures despite the quenched disorder in YCOB.


title: Spending Thinking Time Wisely: Accelerating MCTS with Virtual Expansions

abstract: One of the most important AI research questions is to trade off computation versus performance since ``perfect rationality" exists in theory but is impossible to achieve in practice. Recently, Monte-Carlo tree search (MCTS) has attracted considerable attention due to the significant performance improvement in various challenging domains. However, the expensive time cost during search severely restricts its scope for applications. This paper proposes the Virtual MCTS (V-MCTS), a variant of MCTS that spends more search time on harder states and less search time on simpler states adaptively. We give theoretical bounds of the proposed method and evaluate the performance and computations on $9 \times 9$ Go board games and Atari games. Experiments show that our method can achieve comparable performances to the original search algorithm while requiring less than $50\%$ search time on average. We believe that this approach is a viable alternative for tasks under limited time and resources. The code is available at \url{https://github.com/YeWR/V-MCTS.git}.


title: Scalable estimation and inference for censored quantile regression process

abstract: Censored quantile regression (CQR) has become a valuable tool to study the heterogeneous association between a possibly censored outcome and a set of covariates, yet computation and statistical inference for CQR have remained a challenge for large-scale data with many covariates. In this paper, we focus on a smoothed martingale-based sequential estimating equations approach, to which scalable gradient-based algorithms can be applied. Theoretically, we provide a unified analysis of the smoothed sequential estimator and its penalized counterpart in increasing dimensions. When the covariate dimension grows with the sample size at a sublinear rate, we establish the uniform convergence rate (over a range of quantile indexes) and provide a rigorous justification for the validity of a multiplier bootstrap procedure for inference. In high-dimensional sparse settings, our results considerably improve the existing work on CQR by relaxing an exponential term of sparsity. We also demonstrate the advantage of the smoothed CQR over existing methods with both simulated experiments and data applications.


title: A microwave scattering spectral method to detect the nanomechanical vibrations embedded in a superconducting qubit

abstract: Nanomechanical resonators (NMRs), as the quantum mechanical sensing probers, have played the important roles for various high-precision quantum measurements. Differing from the previous emission spectral probes (i.e., the NMR modified the atomic emission), in this paper we propose an alternative approach, i.e., by probing the scattering spectra of the quantum mechanical prober coupled to the driving microwaves, to characterize the physical features of the NMR embedded in a rf-SQUID based superconducting qubit. It is shown that, from the observed specifical frequency points in the spectra, i.e., either the dips or the peaks, the vibrational features (i.e., they are classical vibration or quantum mechanical one) and the physical parameters (typically such as the vibrational frequency and displacements) of the NMR can be determined effectively. The proposal is feasible with the current technique and should be useful to design the desired NMRs for various quantum metrological applications.


title: LEAGUE: Guided Skill Learning and Abstraction for Long-Horizon Manipulation

abstract: To assist with everyday human activities, robots must solve complex long-horizon tasks and generalize to new settings. Recent deep reinforcement learning (RL) methods show promise in fully autonomous learning, but they struggle to reach long-term goals in large environments. On the other hand, Task and Motion Planning (TAMP) approaches excel at solving and generalizing across long-horizon tasks, thanks to their powerful state and action abstractions. But they assume predefined skill sets, which limits their real-world applications. In this work, we combine the benefits of these two paradigms and propose an integrated task planning and skill learning framework named LEAGUE (Learning and Abstraction with Guidance). LEAGUE leverages the symbolic interface of a task planner to guide RL-based skill learning and creates abstract state space to enable skill reuse. More importantly, LEAGUE learns manipulation skills in-situ of the task planning system, continuously growing its capability and the set of tasks that it can solve. We evaluate LEAGUE on four challenging simulated task domains and show that LEAGUE outperforms baselines by large margins. We also show that the learned skills can be reused to accelerate learning in new tasks domains and transfer to a physical robot platform.


title: A class of weighted isoperimetric inequalities in hyperbolic space

abstract: In this paper, we prove a class of weighted isoperimetric inequalities for bounded domains in hyperbolic space by using the isoperimetric inequality with log-convex density in Euclidean space. As a consequence, we remove the horo-convex assumption of domains in a weighted isoperimetric inequality proved by Scheuer-Xia. Furthermore, we prove weighted isoperimetric inequalities for star-shaped domains in warped product manifolds. Particularly, we obtain a weighted isoperimetric inequality for star-shaped hypersurfaces lying outside a certain radial coordinate slice in the anti-de Sitter-Schwarzschild manifold.


title: Integrated Access and Backhaul in Cell-free Massive MIMO Systems

abstract: One of the major challenges with cell-free (CF) massive multiple-input multiple-output (MIMO) networks is providing backhaul links for a large number of distributed access points (APs). In general, providing fiber optics backhaul for these APs is not cost-effective and also reduces network scalability. Wireless backhauling can be a promising solution that can be integrated with wireless access links to increase spectrum efficiency. In this paper, the application of integrated access and backhaul (IAB) technique in millimeter-wave (mmWave) CF massive MIMO systems is investigated. The access and backhaul links share a frequency spectrum in the mmWave bands, and in both, hybrid beamforming techniques are adopted for signal transmission. The bandwidth allocation (division) parameter between the two link types as well as the beamforming matrices are optimized to maximize the end-to-end data-rate. This leads to a non-convex optimization problem for which an efficient solution method is proposed. The simulation results show the effectiveness of the IAB technique and our proposed scheme in CF massive MIMO systems. These simulations also compare the proposed hybrid beamforming method with a fully digital solution in terms of the number of radio frequency (RF) chains and the volume of backhaul traffic. Finally, the effect of increasing the number of APs on the users data rates in terms of wireless access and backhaul links constraints is also examined.


title: RSVG: Exploring Data and Models for Visual Grounding on Remote Sensing Data

abstract: In this paper, we introduce the task of visual grounding for remote sensing data (RSVG). RSVG aims to localize the referred objects in remote sensing (RS) images with the guidance of natural language. To retrieve rich information from RS imagery using natural language, many research tasks, like RS image visual question answering, RS image captioning, and RS image-text retrieval have been investigated a lot. However, the object-level visual grounding on RS images is still under-explored. Thus, in this work, we propose to construct the dataset and explore deep learning models for the RSVG task. Specifically, our contributions can be summarized as follows. 1) We build the new large-scale benchmark dataset of RSVG, termed RSVGD, to fully advance the research of RSVG. This new dataset includes image/expression/box triplets for training and evaluating visual grounding models. 2) We benchmark extensive state-of-the-art (SOTA) natural image visual grounding methods on the constructed RSVGD dataset, and some insightful analyses are provided based on the results. 3) A novel transformer-based Multi-Level Cross-Modal feature learning (MLCM) module is proposed. Remotely-sensed images are usually with large scale variations and cluttered backgrounds. To deal with the scale-variation problem, the MLCM module takes advantage of multi-scale visual features and multi-granularity textual embeddings to learn more discriminative representations. To cope with the cluttered background problem, MLCM adaptively filters irrelevant noise and enhances salient features. In this way, our proposed model can incorporate more effective multi-level and multi-modal features to boost performance. Furthermore, this work also provides useful insights for developing better RSVG models. The dataset and code will be publicly available at https://github.com/ZhanYang-nwpu/RSVG-pytorch.


title: Quantitative Evidence on Overlooked Aspects of Enrollment Speaker Embeddings for Target Speaker Separation

abstract: Single channel target speaker separation (TSS) aims at extracting a speaker's voice from a mixture of multiple talkers given an enrollment utterance of that speaker. A typical deep learning TSS framework consists of an upstream model that obtains enrollment speaker embeddings and a downstream model that performs the separation conditioned on the embeddings. In this paper, we look into several important but overlooked aspects of the enrollment embeddings, including the suitability of the widely used speaker identification embeddings, the introduction of the log-mel filterbank and self-supervised embeddings, and the embeddings' cross-dataset generalization capability. Our results show that the speaker identification embeddings could lose relevant information due to a sub-optimal metric, training objective, or common pre-processing. In contrast, both the filterbank and the self-supervised embeddings preserve the integrity of the speaker information, but the former consistently outperforms the latter in a cross-dataset evaluation. The competitive separation and generalization performance of the previously overlooked filterbank embedding is consistent across our study, which calls for future research on better upstream features.


title: Multislice Electron Tomography using 4D-STEM

abstract: Electron tomography offers important three-dimensional (3D) structural information which cannot be observed by two-dimensional imaging. By combining annular dark field scanning transmission electron microscopy (ADF-STEM) with aberration correction, the resolution of electron tomography has reached atomic resolution. However, tomography based on ADF-STEM inherently suffers from several issues, including a high electron dose requirement, poor contrast for light elements, and artifacts from image contrast nonlinearity. Here, we developed a new method called MultiSlice Electron Tomography (MSET) based on 4D-STEM tilt series. Our simulations show that multislice-based 3D reconstruction can effectively reduce undesirable reconstruction artifacts from the nonlinear contrast, allowing precise determination of atomic structures with improved sensitivity for low-Z elements, at considerably low electron dose conditions. We expect that the MSET method can be applied to a wide variety of materials, including radiation-sensitive samples and materials containing light elements whose 3D atomic structures have never been fully elucidated due to electron dose limitations or nonlinear imaging contrast.


title: Neural Eigenfunctions Are Structured Representation Learners

abstract: This paper introduces a structured, adaptive-length deep representation called Neural Eigenmap. Unlike prior spectral methods such as Laplacian Eigenmap that operate in a nonparametric manner, Neural Eigenmap leverages NeuralEF to parametrically model eigenfunctions using a neural network. We show that, when the eigenfunction is derived from positive relations in a data augmentation setup, applying NeuralEF results in an objective function that resembles those of popular self-supervised learning methods, with an additional symmetry-breaking property that leads to \emph{structured} representations where features are ordered by importance. We demonstrate using such representations as adaptive-length codes in image retrieval systems. By truncation according to feature importance, our method requires up to $16\times$ shorter representation length than leading self-supervised learning ones to achieve similar retrieval performance. We further apply our method to graph data and report strong results on a node representation learning benchmark with more than one million nodes.


title: Tucker-O-Minus Decomposition for Multi-view Tensor Subspace Clustering

abstract: With powerful ability to exploit latent structure of self-representation information, different tensor decompositions have been employed into low rank multi-view clustering (LRMVC) models for achieving significant performance. However, current approaches suffer from a series of problems related to those tensor decomposition, such as the unbalanced matricization scheme, rotation sensitivity, deficient correlations capture and so forth. All these will lead to LRMVC having insufficient access to global information, which is contrary to the target of multi-view clustering. To alleviate these problems, we propose a new tensor decomposition called Tucker-O-Minus Decomposition (TOMD) for multi-view clustering. Specifically, based on the Tucker format, we additionally employ the O-minus structure, which consists of a circle with an efficient bridge linking two weekly correlated factors. In this way, the core tensor in Tucker format is replaced by the O-minus architecture with a more balanced structure, and the enhanced capacity of capturing the global low rank information will be achieved. The proposed TOMD also provides more compact and powerful representation abilities for the self-representation tensor, simultaneously. The alternating direction method of multipliers is used to solve the proposed model TOMD-MVC. Numerical experiments on six benchmark data sets demonstrate the superiority of our proposed method in terms of F-score, precision, recall, normalized mutual information, adjusted rand index, and accuracy.


title: Survey of Ices toward Massive Young Stellar Objects: I. OCS, CO, OCN$^-$, and CH$_3$OH

abstract: An important tracer of the origin and evolution of cometary ices is the comparison with ices found in dense clouds and towards Young Stellar Objects (YSOs). We present a survey of ices in the 2-5 micron spectra of 23 massive YSOs, taken with the NASA InfraRed Telescope Facility SpeX spectrometer. The 4.90 micron absorption band of OCS ice is detected in 20 sight-lines, more than five times the previously known detections. The absorption profile shows little variation and is consistent with OCS being embedded in CH3OH-rich ices, or proton-irradiated H$_2$S or SO$_2$-containing ices. The OCS column densities correlate well with those of CH$_3$OH and OCN$^-$, but not with H$_2$O and apolar CO ice. This association of OCS with CH$_3$OH and OCN$^-$ firmly establishes their formation location deep inside dense clouds or protostellar envelopes. The median composition of this ice phase towards massive YSOs, as a percentage of H$_2$O, is CO:CH$_3$OH:OCN$^-$:OCS=24:20:1.53:0.15. CS, due to its low abundance, is likely not the main precursor to OCS. Sulfurization of CO is likely needed, although the source of this sulfur is not well constrained. Compared to massive YSOs, low mass YSOs and dense clouds have similar CO and CH$_3$OH ice abundances, but less OCN$^-$ and more apolar CO, while OCS awaits detection. Comets tend to be under-abundant in carbon-bearing species, but this does not appear to be the case for OCS, perhaps signalling OCS production in protoplanetary disks.


title: PoKE: Prior Knowledge Enhanced Emotional Support Conversation with Latent Variable

abstract: Emotional support conversation (ESC) task can utilize various support strategies to help people relieve emotional distress and overcome the problem they face, which has attracted much attention in these years. However, most state-of-the-art works rely heavily on external commonsense knowledge to infer the mental state of the user in every dialogue round. Although effective, they may suffer from significant human effort, knowledge update and domain change in a long run. Therefore, in this article, we focus on exploring the task itself without using any external knowledge. We find all existing works ignore two significant characteristics of ESC. (a) Abundant prior knowledge exists in historical conversations, such as the responses to similar cases and the general order of support strategies, which has a great reference value for current conversation. (b) There is a one-to-many mapping relationship between context and support strategy, i.e.multiple strategies are reasonable for a single context. It lays a better foundation for the diversity of generations. Taking into account these two key factors, we propose Prior Knowledge Enhanced emotional support model with latent variable, PoKE. The proposed model fully taps the potential of prior knowledge in terms of exemplars and strategy sequence and then utilizes a latent variable to model the one-to-many relationship of strategy. Furthermore, we introduce a memory schema to incorporate the encoded knowledge into decoder. Experiment results on benchmark dataset show that our PoKE outperforms existing baselines on both automatic evaluation and human evaluation. Compared with the model using external knowledge, PoKE still can make a slight improvement in some metrics. Further experiments prove that abundant prior knowledge is conducive to high-quality emotional support, and a well-learned latent variable is critical to the diversity of generations.


title: Ringing and echoes from black bounces surrounded by the string cloud

abstract: In the string theory, the fundamental blocks of nature are not particles but one-dimensional strings. Therefore, a generalization of this idea is to think of it as a cloud of strings. Rodrigues et al. embedded the black bounces spacetime into the string cloud, which demonstrates that the existence of the string cloud makes the Bardeen black hole singular, while the black bounces spacetime remains regular. On the other hand, the echoes are the correction to the late stage of the quasinormal ringing for a black hole, which is caused by the deviation of the spacetime relative to the initial black hole spacetime geometry in the near-horizon region. In this work, we study the gravitational wave echoes of black bounces spacetime surrounded by a cloud of strings under scalar field and electromagnetic field perturbation to explore the effects caused by a string cloud in the near-horizon region. The ringing of the regular black hole and traversable wormhole with string cloud are presented. Our results demonstrate that the black bounce spacetime with strings cloud is characterized by gravitational wave echoes as it transitions from regular black holes to wormholes, i.e. the echoes signal will facilitate us to distinguish between black holes and the wormholes in black bounces surrounded by the string cloud.


title: Accelerated Linearized Laplace Approximation for Bayesian Deep Learning

abstract: Laplace approximation (LA) and its linearized variant (LLA) enable effortless adaptation of pretrained deep neural networks to Bayesian neural networks. The generalized Gauss-Newton (GGN) approximation is typically introduced to improve their tractability. However, LA and LLA are still confronted with non-trivial inefficiency issues and should rely on Kronecker-factored, diagonal, or even last-layer approximate GGN matrices in practical use. These approximations are likely to harm the fidelity of learning outcomes. To tackle this issue, inspired by the connections between LLA and neural tangent kernels (NTKs), we develop a Nystrom approximation to NTKs to accelerate LLA. Our method benefits from the capability of popular deep learning libraries for forward mode automatic differentiation, and enjoys reassuring theoretical guarantees. Extensive studies reflect the merits of the proposed method in aspects of both scalability and performance. Our method can even scale up to architectures like vision transformers. We also offer valuable ablation studies to diagnose our method. Code is available at \url{https://github.com/thudzj/ELLA}.


title: Finding matchings in dense hypergraphs

abstract: We consider the algorithmic decision problem that takes as input an $n$-vertex $k$-uniform hypergraph $H$ with minimum codegree at least $m-c$ and decides whether it has a matching of size $m$. We show that this decision problem is fixed parameter tractable with respect to $c$. Furthermore, our algorithm not only decides the problem, but actually either finds a matching of size $m$ or a certificate that no such matching exists. In particular, when $m=n/k$ and $c=O(\log n)$, this gives a polynomial-time algorithm, that given any $n$-vertex $k$-uniform hypergraph $H$ with minimum codegree at least $n/k-c$, finds either a perfect matching in $H$ or a certificate that no perfect matching exists.


title: Deterministic quantum search with adjustable parameters: implementations and applications

abstract: Grover's algorithm provides a quadratic speedup over classical algorithms to search for marked elements in an unstructured database. The original algorithm is probabilistic, returning a marked element with bounded error. There are several schemes to achieve the deterministic version, by using the generalized Grover's iteration $G(\alpha,\beta):=S_r(\beta)\, S_o(\alpha)$ composed of phase oracle $S_o(\alpha)$ and phase rotation $S_r(\beta)$. However, in all the existing schemes the value range of $\alpha$ and $\beta$ is limited; for instance, in the three early schemes $\alpha$ and $\beta$ are determined by the proportion of marked states $M/N$. In this paper, we break through this limitation by presenting a search framework with adjustable parameters, which allows $\alpha$ or $\beta$ to be arbitrarily given. The significance of the framework lies not only in the expansion of mathematical form, but also in its application value, as we present two disparate problems which we are able to solve deterministically using the proposed framework, whereas previous schemes are ineffective.


title: Positively curved Finsler metrics on vector bundles II

abstract: We show that if $E$ is an ample vector bundle of rank at least two with some curvature bound on $O_{P(E^*)}(1)$, then $E^*\otimes \det E$ is Kobayashi positive. The proof relies on comparing the curvature of $(\det E^*)^k$ and $S^kE$ for large $k$ and using duality of convex Finsler metrics. Following the same thread of thought, we show if $E$ is ample with similar curvature bounds on $O_{P(E^*)}(1)$ and $O_{P(E\otimes \det E^*)}(1)$, then $E$ is Kobayashi positive. With additional assumptions, we can furthermore show that $E^*\otimes \det E$ and $E$ are Griffiths positive.


title: ADMM based Fourier phase retrieval with untrained generative prior

abstract: Fourier phase retrieval (FPR) is an inverse problem that recovers the signal from its Fourier magnitude measurement, it's ill-posed especially when the sampling rates are low. In this paper, an untrained generative prior is introduced to attack the ill-posedness. Based on the alternating direction method of multipliers (ADMM), an algorithm utilizing the untrained generative network called Net-ADM is proposed to solve the FPR problem. Firstly, the objective function is smoothed and the dimension of the variable is raised to facilitate calculation. Then an untrained generative network is embedded in the iterative process of ADMM to project an estimated signal into the generative space, and the projected signal is applied to next iteration of ADMM. We theoretically analyzed the two projections included in the algorithm, one makes the objective function descent, and the other gets the estimation closer to the optimal solution. Numerical experiments show that the reconstruction performance and robustness of the proposed algorithm are superior to prior works, especially when the sampling rates are low.


title: Binary sequences with a low correlation via cyclotomic function fields with odd characteristics

abstract: Sequences with a low correlation have very important applications in communications, cryptography, and compressed sensing. In the literature, many efforts have been made to construct good sequences with various lengths where binary sequences attracts great attention. As a result, various constructions of good binary sequences have been proposed. However, most of the known constructions made use of the multiplicative cyclic group structure of finite field $\mathbb{F}_{p^n}$ for a prime $p$ and a positive integer $n$. In fact, all $p^n+1$ rational places including the place at infinity of the rational function field over $\mathbb{F}_{p^n}$ form a cyclic structure under an automorphism of order $p^n+1$. In this paper, we make use of this cyclic structure to provide an explicit construction of binary sequences with a low correlation of length $p^n+1$ via cyclotomic function fields over $\mathbb{F}_{p^n}$ for any odd prime $p$. Each family of binary sequences has size $p^n-2$ and its correlation is upper bounded by $4+\lfloor 2\cdot p^{n/2}\rfloor$. To the best of our knowledge, this is the first construction of binary sequences with a low correlation of length $p^n+1$ for odd prime $p$. Moreover, our sequences can be constructed explicitly and have competitive parameters.


title: Clarinet: A Music Retrieval System

abstract: A MIDI based approach for music recognition is proposed and implemented in this paper. Our Clarinet music retrieval system is designed to search piano MIDI files with high recall and speed. We design a novel melody extraction algorithm that improves recall results by more than 10%. We also implement 3 algorithms for retrieval-two self designed (RSA Note and RSA Time), and a modified version of the Mongeau Sankoff Algorithm. Algorithms to achieve tempo and scale invariance are also discussed in this paper. The paper also contains detailed experimentation and benchmarks with four different metrics. Clarinet achieves recall scores of more than 94%.


title: Anticipative Feature Fusion Transformer for Multi-Modal Action Anticipation

abstract: Although human action anticipation is a task which is inherently multi-modal, state-of-the-art methods on well known action anticipation datasets leverage this data by applying ensemble methods and averaging scores of unimodal anticipation networks. In this work we introduce transformer based modality fusion techniques, which unify multi-modal data at an early stage. Our Anticipative Feature Fusion Transformer (AFFT) proves to be superior to popular score fusion approaches and presents state-of-the-art results outperforming previous methods on EpicKitchens-100 and EGTEA Gaze+. Our model is easily extensible and allows for adding new modalities without architectural changes. Consequently, we extracted audio features on EpicKitchens-100 which we add to the set of commonly used features in the community.


title: Hierarchical auxetic and isotropic porous medium with extremely negative Poisson's ratio

abstract: We propose a novel two-dimensional hierarchical auxetic structure consisting of a porous medium in which a homogeneous matrix includes a rank-two set of cuts characterised by different scales. The six-fold symmetry of the perforations makes the medium isotropic in the plane. Remarkably, the mesoscale interaction between the first- and second-level cuts enables the attainment of a value of the Poisson's ratio close to the minimum reachable limit of -1. The effective properties of the hierarchical auxetic structure are determined numerically, considering both a unit cell with periodic boundary conditions and a finite structure containing a large number of repeating cells. Further, results of the numerical study are validated experimentally on a polymeric specimen with appropriately arranged rank-two cuts, tested under uniaxial tension. We envisage that the proposed hierarchical design can be useful in numerous engineering applications exploiting an extreme auxetic effect


title: Unsupervised Non-transferable Text Classification

abstract: Training a good deep learning model requires substantial data and computing resources, which makes the resulting neural model a valuable intellectual property. To prevent the neural network from being undesirably exploited, non-transferable learning has been proposed to reduce the model generalization ability in specific target domains. However, existing approaches require labeled data for the target domain which can be difficult to obtain. Furthermore, they do not have the mechanism to still recover the model's ability to access the target domain. In this paper, we propose a novel unsupervised non-transferable learning method for the text classification task that does not require annotated target domain data. We further introduce a secret key component in our approach for recovering the access to the target domain, where we design both an explicit and an implicit method for doing so. Extensive experiments demonstrate the effectiveness of our approach.


title: Implications of photon-ALP oscillations in the extragalactic neutrino source TXS 0506+056 at sub-PeV energies

abstract: Photon-axion-like particle (ALP) oscillations result in the survival of gamma rays from distant sources above TeV energies. Studies of events observed by CAST, Fermi-LAT, and IACT have constrained the ALP parameters. We investigate the effect of photon-ALP oscillations on the gamma-ray spectra of the first extragalactic neutrino source, TXS 0506+056, for observations by Fermi-LAT and MAGIC around the IC170922-A alert. We obtain a constraint on the ALP coupling parameter $g_{a\gamma} < 5 \times 10^{-11}$ GeV$^{-1}$ with 95% C.L. when focusing on the ALP mass range 0.1 neV $\le$ $m_a$ $\le$ 1000 neV. Importantly, we study the implications of ALP-$\gamma$ oscillations on the counterpart $\gamma$ rays of the sub-PeV neutrinos observed from TXS 0506+056. We also show the diffuse $\gamma$-ray fluxes and observabilities from flat-spectrum radio quasars, high-synchrotron peaked sources, and low-intermediate-synchrotron peaked sources, assuming similar gamma-ray emissions as that from TXS 0506+056.


title: SAT: Improving Semi-Supervised Text Classification with Simple Instance-Adaptive Self-Training

abstract: Self-training methods have been explored in recent years and have exhibited great performance in improving semi-supervised learning. This work presents a Simple instance-Adaptive self-Training method (SAT) for semi-supervised text classification. SAT first generates two augmented views for each unlabeled data and then trains a meta-learner to automatically identify the relative strength of augmentations based on the similarity between the original view and the augmented views. The weakly-augmented view is fed to the model to produce a pseudo-label and the strongly-augmented view is used to train the model to predict the same pseudo-label. We conducted extensive experiments and analyses on three text classification datasets and found that with varying sizes of labeled training data, SAT consistently shows competitive performance compared to existing semi-supervised learning methods. Our code can be found at \url{https://github.com/declare-lab/SAT.git}.


title: Cross-document Event Coreference Search: Task, Dataset and Modeling

abstract: The task of Cross-document Coreference Resolution has been traditionally formulated as requiring to identify all coreference links across a given set of documents. We propose an appealing, and often more applicable, complementary set up for the task - Cross-document Coreference Search, focusing in this paper on event coreference. Concretely, given a mention in context of an event of interest, considered as a query, the task is to find all coreferring mentions for the query event in a large document collection. To support research on this task, we create a corresponding dataset, which is derived from Wikipedia while leveraging annotations in the available Wikipedia Event Coreference dataset (WEC-Eng). Observing that the coreference search setup is largely analogous to the setting of Open Domain Question Answering, we adapt the prominent Deep Passage Retrieval (DPR) model to our setting, as an appealing baseline. Finally, we present a novel model that integrates a powerful coreference scoring scheme into the DPR architecture, yielding improved performance.


title: A Trustless Architecture of Blockchain-enabled Metaverse

abstract: Metaverse has rekindled human beings' desire to further break space-time barriers by fusing the virtual and real worlds. However, security and privacy threats hinder us from building a utopia. A metaverse embraces various techniques, while at the same time inheriting their pitfalls and thus exposing large attack surfaces. Blockchain, proposed in 2008, was regarded as a key building block of metaverses. it enables transparent and trusted computing environments using tamper-resistant decentralized ledgers. Currently, blockchain supports Decentralized Finance (DeFi) and Non-fungible Tokens (NFT) for metaverses. However, the power of a blockchain has not been sufficiently exploited. In this article, we propose a novel trustless architecture of blockchain-enabled metaverse, aiming to provide efficient resource integration and allocation by consolidating hardware and software components. To realize our design objectives, we provide an On-Demand Trusted Computing Environment (OTCE) technique based on local trust evaluation. Specifically, the architecture adopts a hypergraph to represent a metaverse, in which each hyperedge links a group of users with certain relationship. Then the trust level of each user group can be evaluated based on graph analytics techniques. Based on the trust value, each group can determine its security plan on demand, free from interference by irrelevant nodes. Besides, OTCEs enable large-scale and flexible application environments (sandboxes) while preserving a strong security guarantee.


title: Robust substrate anchorages of silk lines with extensible nano-fibres

abstract: Living systems are built of multiscale-composites: materials formed of components with different properties that are assembled in complex micro- and nano-structures. Such biological multiscale-composites often show outstanding physical properties that are unachieved by artificial materials. A major scientific goal is thus to understand the assembly processes and the relationship between structure and function in order to reproduce them in a new generation of biomimetic high-performance materials. Here, we tested how the assembly of spider silk nano-fibres (i.e. glue coated 0.5 micron thick fibres produced by so-called piriform glands) into different micro-structures correlates with mechanical performance by empirically and numerically exploring the mechanical behaviour of line anchors in an orb weaver, a hunting spider and two ancient web builders. We demonstrate that the anchors of orb weavers exhibit outstanding mechanical robustness with minimal material use by the indirect attachment of the silk line to the substrate through a soft domain ('bridge'). This principle can be used to design new artificial high-performance attachment systems.


title: Deciphering Contact Interactions and Exploration Strategies Underlying Tactile Perception of Material Softness

abstract: Our sense of touch is essential and permeates in interactions involving natural explorations and affective communications. For instance, we routinely judge the ripeness of fruit at the grocery store, caress the arm of a spouse to offer comfort, and stroke textiles to gauge their softness. Meanwhile, interactive displays that provide tactile feedback are becoming normal and ubiquitous in our daily lives, and are extending rich and immersive interactions into augmented and virtual reality. To replicate touch sensation and make virtual objects feel tangible, such feedback will need to relay a sense of compliance, or softness, one of the key dimensions underlying haptic perception. As our understanding of softness perception remains incomplete, this study seeks to understand exploratory strategies and perceptual cues that may optimally encode material softness. Specifically, we employ methods of computational finite element modeling, biomechanical experimentation, psychophysical evaluation, and data-driven analysis. Overall, this work may aid in engineering the next-generation wearable haptic displays, which must be more tangible, compatible, and perceptually naturalistic.


title: Extending Phrase Grounding with Pronouns in Visual Dialogues

abstract: Conventional phrase grounding aims to localize noun phrases mentioned in a given caption to their corresponding image regions, which has achieved great success recently. Apparently, sole noun phrase grounding is not enough for cross-modal visual language understanding. Here we extend the task by considering pronouns as well. First, we construct a dataset of phrase grounding with both noun phrases and pronouns to image regions. Based on the dataset, we test the performance of phrase grounding by using a state-of-the-art literature model of this line. Then, we enhance the baseline grounding model with coreference information which should help our task potentially, modeling the coreference structures with graph convolutional networks. Experiments on our dataset, interestingly, show that pronouns are easier to ground than noun phrases, where the possible reason might be that these pronouns are much less ambiguous. Additionally, our final model with coreference information can significantly boost the grounding performance of both noun phrases and pronouns.


title: Mapping Process for the Task: Wikidata Statements to Text as Wikipedia Sentences

abstract: Acknowledged as one of the most successful online cooperative projects in human society, Wikipedia has obtained rapid growth in recent years and desires continuously to expand content and disseminate knowledge values for everyone globally. The shortage of volunteers brings to Wikipedia many issues, including developing content for over 300 languages at the present. Therefore, the benefit that machines can automatically generate content to reduce human efforts on Wikipedia language projects could be considerable. In this paper, we propose our mapping process for the task of converting Wikidata statements to natural language text (WS2T) for Wikipedia projects at the sentence level. The main step is to organize statements, represented as a group of quadruples and triples, and then to map them to corresponding sentences in English Wikipedia. We evaluate the output corpus in various aspects: sentence structure analysis, noise filtering, and relationships between sentence components based on word embedding models. The results are helpful not only for the data-to-text generation task but also for other relevant works in the field.


title: Mean Field Games with Major and Minor Agents and Conditional Distribution Dependent FBSDEs

abstract: In this paper, we consider mean field games (MFGs) with a major and $N$ minor agents. We first consider the limiting problem and allow the state coefficients to vary with the conditional distribution in a nonlinear way. We use the sufficient Pontryagin principle for optimality to transform the limiting control problem into a system of two coupled conditional distribution dependent forward backward stochastic differential equations (FBSDEs), and prove the existence and uniqueness of solutions of the FBSDEs when the dependence between major agent and minor agents is sufficiently weak and the convexity parameter of the running cost of minor agents on the control is sufficiently large. A weak monotonicity property is required for minor agents' cost functions and the proof is based on a continuation method in coefficients. We then consider the equilibrium property of MFG with major and minor agents and use the solution of the limit problem to construct an $\mathcal{O}(N^{-\frac{1}{2}})$-Nash equilibrium for MFG with a major and $N$ minor agents.


title: A Schelling Extended Model in Networks -- Characterization of Ghettos in Washington D.C

abstract: Segregation affects millions of urban dwellers. The main expression of this reality is the creation of ghettos which are city parts characterized by a combination of features: low income, poor cultural level... Segregation models have been usually defined over regular lattices. However, in recent years, the focus has shifted from these unrealistic frameworks to other environments defined via geographic information systems (GIS) or networks. Nevertheless, each one of them has its drawbacks: GIS demands high-resolution data, that are not always available, and networks tend to have limited real-world applications. Our work tries to fill the gap between them. First, we use some basic GIS information to define the network, and then, run an extended Schelling model on it. As a result, we obtain the location of ghettos. After that, we analyze which parts of the city are segregated, via spatial analysis and machine learning and compare our results. For the case study of Washington D.C., we obtain an $80\%$ accuracy.


title: Improving Chinese Named Entity Recognition by Search Engine Augmentation

abstract: Compared with English, Chinese suffers from more grammatical ambiguities, like fuzzy word boundaries and polysemous words. In this case, contextual information is not sufficient to support Chinese named entity recognition (NER), especially for rare and emerging named entities. Semantic augmentation using external knowledge is a potential way to alleviate this problem, while how to obtain and leverage external knowledge for the NER task remains a challenge. In this paper, we propose a neural-based approach to perform semantic augmentation using external knowledge from search engine for Chinese NER. In particular, a multi-channel semantic fusion model is adopted to generate the augmented input representations, which aggregates external related texts retrieved from the search engine. Experiments have shown the superiority of our model across 4 NER datasets, including formal and social media language contexts, which further prove the effectiveness of our approach.


title: No-Regret Learning in Two-Echelon Supply Chain with Unknown Demand Distribution

abstract: Supply chain management (SCM) has been recognized as an important discipline with applications to many industries, where the two-echelon stochastic inventory model, involving one downstream retailer and one upstream supplier, plays a fundamental role for developing firms' SCM strategies. In this work, we aim at designing online learning algorithms for this problem with an unknown demand distribution, which brings distinct features as compared to classic online optimization problems. Specifically, we consider the two-echelon supply chain model introduced in [Cachon and Zipkin, 1999] under two different settings: the centralized setting, where a planner decides both agents' strategy simultaneously, and the decentralized setting, where two agents decide their strategy independently and selfishly. We design algorithms that achieve favorable guarantees for both regret and convergence to the optimal inventory decision in both settings, and additionally for individual regret in the decentralized setting. Our algorithms are based on Online Gradient Descent and Online Newton Step, together with several new ingredients specifically designed for our problem. We also implement our algorithms and show their empirical effectiveness.


title: Rigidity of center Lyapunov exponents for Anosov diffeomorphisms on 3-torus

abstract: Let f and g be two Anosov diffeomorphisms on T3 with three-subbundles partially hyperbolic splittings where the weak stable subbundles are considered as center subbundles. Assume that f is conjugate to g and the conjugacy preserves the strong stable foliation, then their center Lyapunov exponents of corresponding periodic points coincide. This is the converse of the main result of Gogolev and Guysinsky in [9]. Moreover, we get the same result for partially hyperbolic diffeomorphisms derived from Anosov on T3.


title: Non-simple polyominoes of K\H{o}nig type and their canonical module

abstract: We study the K\H{o}nig type property for non-simple polyominoes. We prove that, for closed path polyominoes, the polyomino ideals are of K\H{o}nig type, extending the results of Herzog and Hibi for simple thin polyominoes. As an application of this result, we give a combinatorial interpretation for the canonical module of the coordinate ring of a sub-class of closed path polyominoes, namely circle closed path polyominoes. In this case, we compute also the Cohen-Macaulay type and we show that $K[\mathcal{P}]$ is a level ring.


title: Some Characterizations of Relative Sequentially Cohen-Macaulay and Relative Cohen-Macaulay Modules

abstract: Let $M$ be an $R$-module over a Noetherian ring $R$ and $\mathfrak{a}$ be an ideal of $R$ with $c={\rm cd}(\mathfrak{a},M)$. First, we prove that $M$ is finite $\mathfrak{a}$-relative Cohen-Macaulay if and only if ${\rm H}_i(\Lambda_{\mathfrak{a}}({\rm H}_{\mathfrak{a}}^c(M)))=0$ for all $i\neq c$ and ${\rm H}_c(\Lambda_{\mathfrak{a}}({\rm H}_{\mathfrak{a}}^c(M))) \cong \widehat{M}^{\mathfrak{a}}$. Next, over an $\mathfrak{a}$-relative Cohen-Macaulay local ring $(R,\mathfrak{m})$, we provide a characterization of $\mathfrak{a}$-relative sequentially Cohen-Macaulay modules $M$ in terms of $\mathfrak{a}$-relative Cohen-Macaulayness of the $R$-modules ${\rm Ext}^{d-i}_{R}(M,{\rm D}_{\mathfrak{a}})$ for all $i\geq 0$, where ${\rm D}_{\mathfrak{a}} = {\rm Hom}_R({\rm H}^d_{\mathfrak{a}}(R),{\rm E}(R/\mathfrak{m}))$ and $d={\rm cd}(\mathfrak{a},R)$. Finally, we provide another characterization of $\mathfrak{a}$-relative sequentially Cohen-Macaulay modules $M$ in terms of vanishing of the local homology modules ${\rm H}_j(\Lambda_{\mathfrak{a}}({\rm H}_{\mathfrak{a}}^i(M)))=0$ for all $0\leq i\leq c$ and for all $j\neq i$.


title: Physical and chemical vertical structure of magnetostatic accretion disks of young stars

abstract: The vertical structure of the accretion disks of young stars with fossil large-scale magnetic field is studied. The equations of magnetostatic equilibrium of the disk are solved taking into account the stellar gravity, gas and magnetic pressure, turbulent heating, and heating by stellar radiation. The modelled physical structure of the disk is used to simulate its chemical structure, in particular, to study the spatial distribution of CN molecules. The disk of the typical T Tauri star is considered. Simulations show that the temperature within the disk in the region $r<50$ au decreases with height and density profiles are steeper than in the isothermal case. Outside the `dead' zone, vertical profiles of the azimuthal component of the magnetic field are nonmonotonic, and the magnetic field strength maximum is reached within the disk. The magnetic pressure gradient can cause an increase in the disk thickness in comparison with the hydrostatic one. The CN molecule concentration is maximum near the photosphere and in the disk atmosphere where the magnetic field strength at chosen parameters is $\sim 0.01$ G. Measurements of the Zeeman splitting of CN lines in the submm range can be used to determine the magnetic field strength in these regions of accretion disks.


title: On Rees algebras of 2-determinantal ideals

abstract: Let I be the ideal of minors of a 2 by n matrix of linear forms with the expected codimension. In this paper we prove that the Rees algebra of I and its special fiber ring are Cohen-Macaulay and Koszul; in particular, they are quadratic algebras. The main novelty in our approach is the analysis of a stratification of the Hilbert scheme of determinantal ideals. We study degenerations of Rees algebras along this stratification, and combine it with certain squarefree Groebner degenerations.


title: Meta Learning of Interface Conditions for Multi-Domain Physics-Informed Neural Networks

abstract: Physics-informed neural networks (PINNs) are emerging as popular mesh-free solvers for partial differential equations (PDEs). Recent extensions decompose the domain, apply different PINNs to solve the problem in each subdomain, and stitch the subdomains at the interface. Thereby, they can further alleviate the problem complexity, reduce the computational cost, and allow parallelization. However, the performance of multi-domain PINNs is sensitive to the choice of the interface conditions. While quite a few conditions have been proposed, there is no suggestion about how to select the conditions according to specific problems. To address this gap, we propose META Learning of Interface Conditions (METALIC), a simple, efficient yet powerful approach to dynamically determine appropriate interface conditions for solving a family of parametric PDEs. Specifically, we develop two contextual multi-arm bandit (MAB) models. The first one applies to the entire training course, and online updates a Gaussian process (GP) reward that given the PDE parameters and interface conditions predicts the performance. We prove a sub-linear regret bound for both UCB and Thompson sampling, which in theory guarantees the effectiveness of our MAB. The second one partitions the training into two stages, one is the stochastic phase and the other deterministic phase; we update a GP reward for each phase to enable different condition selections at the two stages to further bolster the flexibility and performance. We have shown the advantage of METALIC on four bench-mark PDE families.


title: How the reversible change of contact network affects the epidemic spreading

abstract: The mobility patterns of individuals in China during the early outbreak of the COVID-19 pandemic exhibit reversible changes -- in many regions, the mobility first decreased significantly and later restored. Based on this observation, here we study the classical SIR model on a particular type of time-varying network where the links undergo a freeze-recovery process. We first focus on an isolated network and find that the recovery mechanism could lead to the resurgence of an epidemic. The influence of link freezing on epidemic dynamics is subtle. In particular, we show that there is an optimal value of the freezing rate for links which corresponds to the lowest prevalence of the epidemic. This result challenges our conventional idea that stricter prevention measures (corresponding to a larger freezing rate) could always have a better inhibitory effect on epidemic spreading. We further investigate an open system where a small fraction of nodes in the network may acquire the disease from the "environment" (the outside infected nodes). In this case, the second wave would appear even if the number of infected nodes has declined to zero, which can not be explained by the isolated network model.


title: Tomographic Alcock-Paczynski Method with Redshift Errors

abstract: The tomographic Alcock-Paczynski (AP) method is a promising method that uses the redshift evolution of the anisotropic clustering in redshift space to calibrate cosmology. It extends the applicable range of AP method to substantially nonlinear scales, yielding very tight cosmological constraints. For future stage-IV slitless spectroscopic surveys, the non-negligible redshift errors might reduce the advantage of the tomographic AP method by suppressing the resolution of the nonlinear structure along the line of sight. The present work studies how redshift errors propagate to cosmological parameters in the tomographic AP analysis. We use a formula $\sigma_z = \sigma(1+z)^{\alpha} $ to model the redshift errors, with $\sigma$ varying from 0.001 to 0.006 and $\alpha$ varying from 0.5 to 1.5. The redshift errors produce a signal of anisotropic clustering that is similar to a strong finger-of-god effect, which smears out both the AP signal and the contamination caused by the redshift space distortions (RSD). For the target precision of the Chinese Space Station Telescope optical survey ($\sigma\lesssim 0.002$), the decrement of constraining power on the dark energy equation of state is mild ($\lesssim 50\%$), and the suppression of RSD contamination leads to a smaller bias-to-signal ratio. Our results indicate that the tomographic AP method will remain a useful and complementary tool for analyses of future slitless spectroscopic surveys.


title: Infrared Spectroscopic Survey of the Quiescent Medium of Nearby Clouds: II. Ice Formation and Grain Growth in Perseus and Serpens

abstract: The properties of dust change during the transition from diffuse to dense clouds as a result of ice formation and dust coagulation, but much is still unclear about this transformation. We present 2-20 micron spectra of 49 field stars behind the Perseus and Serpens Molecular Clouds and establish relationships between the near-infrared continuum extinction (AK) and the depths of the 9.7 micron silicate (tau97) and 3.0 micron H2O ice (tau30) absorption bands. The tau97/AK ratio varies from large, diffuse interstellar medium-like values (~0.55), to much lower ratios (~0.26). Above extinctions of AK~1.2 (AV~10; Perseus, Lupus, dense cores) and ~2.0 (AV~17; Serpens), the tau97/AK ratio is lowest. The tau97/AK reduction from diffuse to dense clouds is consistent with a moderate degree of grain growth (sizes up to ~0.5 micron), increasing the near-infrared color excess (and thus AK), but not affecting ice and silicate band profiles. This grain growth process seems to be related to the ice column densities and dense core formation thresholds, highlighting the importance of density. After correction for Serpens foreground extinction, the H2O ice formation threshold is in the range of AK=0.31-0.40 (AV=2.6-3.4) for all clouds, and thus grain growth takes place after the ices are formed. Finally, abundant CH3OH ice (~21% relative to H2O) is reported for 2MASSJ18285266+0028242 (Serpens), a factor of >4 larger than for the other targets.


title: Lexical Generalization Improves with Larger Models and Longer Training

abstract: While fine-tuned language models perform well on many tasks, they were also shown to rely on superficial surface features such as lexical overlap. Excessive utilization of such heuristics can lead to failure on challenging inputs. We analyze the use of lexical overlap heuristics in natural language inference, paraphrase detection, and reading comprehension (using a novel contrastive dataset), and find that larger models are much less susceptible to adopting lexical overlap heuristics. We also find that longer training leads models to abandon lexical overlap heuristics. Finally, we provide evidence that the disparity between models size has its source in the pre-trained model


title: Towards Generalizable and Robust Text-to-SQL Parsing

abstract: Text-to-SQL parsing tackles the problem of mapping natural language questions to executable SQL queries. In practice, text-to-SQL parsers often encounter various challenging scenarios, requiring them to be generalizable and robust. While most existing work addresses a particular generalization or robustness challenge, we aim to study it in a more comprehensive manner. In specific, we believe that text-to-SQL parsers should be (1) generalizable at three levels of generalization, namely i.i.d., zero-shot, and compositional, and (2) robust against input perturbations. To enhance these capabilities of the parser, we propose a novel TKK framework consisting of Task decomposition, Knowledge acquisition, and Knowledge composition to learn text-to-SQL parsing in stages. By dividing the learning process into multiple stages, our framework improves the parser's ability to acquire general SQL knowledge instead of capturing spurious patterns, making it more generalizable and robust. Experimental results under various generalization and robustness settings show that our framework is effective in all scenarios and achieves state-of-the-art performance on the Spider, SParC, and CoSQL datasets. Code can be found at https://github.com/AlibabaResearch/DAMO-ConvAI/tree/main/tkk.


title: The geodesic cover problem for butterfly networks

abstract: A geodesic cover, also known as an isometric path cover, of a graph is a set of geodesics which cover the vertex set of the graph. An edge geodesic cover of a graph is a set of geodesics which cover the edge set of the graph. The geodesic (edge) cover number of a graph is the cardinality of a minimum (edge) geodesic cover. The (edge) geodesic cover problem of a graph is to find the (edge) geodesic cover number of the graph. Surprisingly, only partial solutions for these problems are available for most situations. In this paper we demonstrate that the geodesic cover number of the $r$-dimensional butterfly is $\lceil (2/3)2^r\rceil$ and that its edge geodesic cover number is $2^r$.


title: Subordinators on Feller Topological Monoids

abstract: We investigate a class of topological monoids with a suitable family of characters which we call Feller topological monoids. We extend the classical notion of subordinators to subordinators on Feller topological monoids. Under suitable assumptions, we prove a L\'evy-Khintchine type representation for such subordinators. In addition, a L\'evy-It\^o like decomposition is obtained. These formulae generalize the classical ones for subordinators.


title: Orthogonal projections of planar sets in countable directions

abstract: Given $0<t\le 1$ and $C>0$. For any $t/2\le s<t$, we prove that there exists a finite subset $\Omega\subset S^1$, such that for all $t$-Ahlfors-David regular set $E\subset [0,1)^2$ with regular constant at most $C$, we have $$ \max_{e\in \Omega} \overline{\dim}_B \pi_e(E)\ge s, $$ where $\pi_e(E)$ stands for the orthogonal projection of $E$ into the line spanned by $e\in S^1$. This was known earlier, due to Orponen (2016), for the situation $t=1$. As an application of our results, I show that there exists a countable subset $\Omega\subset S^1$ such that for any $t$-Ahlfors-David regular set $E\subseteq [0,1)^2$, with $0<t\le 2$, one has $$ \sup_{e\in \Omega} \overline{\dim}_B \pi_e(E)=\min\{t, 1\}. $$ Moreover, for $0<t\le 1$ there exists $t$-Ahlfors-David regular set such that the supremum is not attained.