title: New Globular Cluster Candidates in the M81 group

abstract: The study of outer halo globular cluster (GC) populations can give insight into galaxy merging, globular cluster accretion and the origin of GCs. We use archival Subaru Hyper Suprime-Cam (HSC) data in concert with space-based GALEX, IRAC and Gaia EDR3 data to select candidate Globular clusters (GCs) in the outer halo of the M81 group for confirmation and future study. We use a small sample of previously-discovered GCs to tune our selection criteria, finding that bright already-known GCs in the M81 group have sizes that are typically slightly larger than the Subaru PSF in our fields. In the optical bands, GCs appear to have colours that are only slightly different from stars. The inclusion of archival IRAC data yields dramatic improvements in colour separation, as the long wavelength baseline aids somewhat in the separation from stars and clearly separates GCs from many compact background galaxies. We show that some previously spectroscopically-identified GCs in the M81 group are instead foreground stars or background galaxies. GCs close to M82 have radial velocities suggesting that they fell into the M81 group along with M82. The overall M81 GC luminosity function is similar to the Milky Way and M31. M81's outer halo GCs are similar to the Milky Way in their metallicities and numbers, and much less numerous than M31's more metal-rich outer halo GC population. These properties reflect differences in the three galaxies' merger histories, highlighting the possibility of using outer halo GCs to trace merger history in larger samples of galaxies.


title: Implicit Regularization or Implicit Conditioning? Exact Risk Trajectories of SGD in High Dimensions

abstract: Stochastic gradient descent (SGD) is a pillar of modern machine learning, serving as the go-to optimization algorithm for a diverse array of problems. While the empirical success of SGD is often attributed to its computational efficiency and favorable generalization behavior, neither effect is well understood and disentangling them remains an open problem. Even in the simple setting of convex quadratic problems, worst-case analyses give an asymptotic convergence rate for SGD that is no better than full-batch gradient descent (GD), and the purported implicit regularization effects of SGD lack a precise explanation. In this work, we study the dynamics of multi-pass SGD on high-dimensional convex quadratics and establish an asymptotic equivalence to a stochastic differential equation, which we call homogenized stochastic gradient descent (HSGD), whose solutions we characterize explicitly in terms of a Volterra integral equation. These results yield precise formulas for the learning and risk trajectories, which reveal a mechanism of implicit conditioning that explains the efficiency of SGD relative to GD. We also prove that the noise from SGD negatively impacts generalization performance, ruling out the possibility of any type of implicit regularization in this context. Finally, we show how to adapt the HSGD formalism to include streaming SGD, which allows us to produce an exact prediction for the excess risk of multi-pass SGD relative to that of streaming SGD (bootstrap risk).

categories: stat.ML cs.LG math.OC math.PR math.ST stat.TH


title: TeKo: Text-Rich Graph Neural Networks with External Knowledge

abstract: Graph Neural Networks (GNNs) have gained great popularity in tackling various analytical tasks on graph-structured data (i.e., networks). Typical GNNs and their variants follow a message-passing manner that obtains network representations by the feature propagation process along network topology, which however ignore the rich textual semantics (e.g., local word-sequence) that exist in many real-world networks. Existing methods for text-rich networks integrate textual semantics by mainly utilizing internal information such as topics or phrases/words, which often suffer from an inability to comprehensively mine the text semantics, limiting the reciprocal guidance between network structure and text semantics. To address these problems, we propose a novel text-rich graph neural network with external knowledge (TeKo), in order to take full advantage of both structural and textual information within text-rich networks. Specifically, we first present a flexible heterogeneous semantic network that incorporates high-quality entities and interactions among documents and entities. We then introduce two types of external knowledge, that is, structured triplets and unstructured entity description, to gain a deeper insight into textual semantics. We further design a reciprocal convolutional mechanism for the constructed heterogeneous semantic network, enabling network structure and textual semantics to collaboratively enhance each other and learn high-level network representations. Extensive experimental results on four public text-rich networks as well as a large-scale e-commerce searching dataset illustrate the superior performance of TeKo over state-of-the-art baselines.


title: Carmichael Numbers with Prime Numbers of Prime Factors

abstract: Under the assumption of Heath-Brown's conjecture on the first prime in an arithmetic progression, we prove that there are infinitely many Carmichael numbers $n$ such that the number of prime factors of $n$ is prime.


title: GRAM-HD: 3D-Consistent Image Generation at High Resolution with Generative Radiance Manifolds

abstract: Recent works have shown that 3D-aware GANs trained on unstructured single image collections can generate multiview images of novel instances. The key underpinnings to achieve this are a 3D radiance field generator and a volume rendering process. However, existing methods either cannot generate high-resolution images (e.g., up to 256X256) due to the high computation cost of neural volume rendering, or rely on 2D CNNs for image-space upsampling which jeopardizes the 3D consistency across different views. This paper proposes a novel 3D-aware GAN that can generate high resolution images (up to 1024X1024) while keeping strict 3D consistency as in volume rendering. Our motivation is to achieve super-resolution directly in the 3D space to preserve 3D consistency. We avoid the otherwise prohibitively-expensive computation cost by applying 2D convolutions on a set of 2D radiance manifolds defined in the recent generative radiance manifold (GRAM) approach, and apply dedicated loss functions for effective GAN training at high resolution. Experiments on FFHQ and AFHQv2 datasets show that our method can produce high-quality 3D-consistent results that significantly outperform existing methods. It makes a significant step towards closing the gap between traditional 2D image generation and 3D-consistent free-view generation.


title: Noise Covariance Estimation in Multi-Task High-dimensional Linear Models

abstract: This paper studies the multi-task high-dimensional linear regression models where the noise among different tasks is correlated, in the moderately high dimensional regime where sample size $n$ and dimension $p$ are of the same order. Our goal is to estimate the covariance matrix of the noise random vectors, or equivalently the correlation of the noise variables on any pair of two tasks. Treating the regression coefficients as a nuisance parameter, we leverage the multi-task elastic-net and multi-task lasso estimators to estimate the nuisance. By precisely understanding the bias of the squared residual matrix and by correcting this bias, we develop a novel estimator of the noise covariance that converges in Frobenius norm at the rate $n^{-1/2}$ when the covariates are Gaussian. This novel estimator is efficiently computable. Under suitable conditions, the proposed estimator of the noise covariance attains the same rate of convergence as the "oracle" estimator that knows in advance the regression coefficients of the multi-task model. The Frobenius error bounds obtained in this paper also illustrate the advantage of this new estimator compared to a method-of-moments estimator that does not attempt to estimate the nuisance. As a byproduct of our techniques, we obtain an estimate of the generalization error of the multi-task elastic-net and multi-task lasso estimators. Extensive simulation studies are carried out to illustrate the numerical performance of the proposed method.


title: Investigation of stellar magnetic activity using variational autoencoder based on low-resolution spectroscopic survey

abstract: We apply the variational autoencoder (VAE) to the LAMOST-K2 low-resolution spectra to detect the magnetic activity of the stars in the K2 field. After the training on the spectra of the selected inactive stars, the VAE model can efficiently generate the synthetic reference templates needed by the spectral subtraction procedure, without knowing any stellar parameters. Then we detect the peculiar spectral features, such as chromospheric emissions, strong nebular emissions and lithium absorptions, in our sample. We measure the emissions of the chromospheric activity indicators, H$\alpha$ and Ca II infrared triplet (IRT) lines, to quantify the stellar magnetic activity. The excess emissions of H$\alpha$ and Ca II IRT lines of the active stars are correlated well to the rotational periods and the amplitudes of light curves derived from the K2 photometry. We degrade the LAMOST spectra to simulate the slitless spectra of the China Space Station Telescope (CSST) and apply the VAE to the simulated data. For cool active stars, we reveal a good agreement between the equivalent widths (EWs) of H$\alpha$ line derived from the spectra with two resolutions. The result indicates the ability of identifying the magnetically active stars in the future CSST survey, which will deliver an unprecedented large database of low-resolution spectra as well as simultaneous multi-band photometry of stars.


title: CLNode: Curriculum Learning for Node Classification

abstract: Node classification is a fundamental graph-based task that aims to predict the classes of unlabeled nodes, for which Graph Neural Networks (GNNs) are the state-of-the-art methods. Current GNNs assume that nodes in the training set contribute equally during training. However, the quality of training nodes varies greatly, and the performance of GNNs could be harmed by two types of low-quality training nodes: (1) inter-class nodes situated near class boundaries that lack the typical characteristics of their corresponding classes. Because GNNs are data-driven approaches, training on these nodes could degrade the accuracy. (2) mislabeled nodes. In real-world graphs, nodes are often mislabeled, which can significantly degrade the robustness of GNNs. To mitigate the detrimental effect of the low-quality training nodes, we present CLNode, which employs a selective training strategy to train GNN based on the quality of nodes. Specifically, we first design a multi-perspective difficulty measurer to accurately measure the quality of training nodes. Then, based on the measured qualities, we employ a training scheduler that selects appropriate training nodes to train GNN in each epoch. To evaluate the effectiveness of CLNode, we conduct extensive experiments by incorporating it in six representative backbone GNNs. Experimental results on real-world networks demonstrate that CLNode is a general framework that can be combined with various GNNs to improve their accuracy and robustness.


title: Self-Supervised Learning of Image Scale and Orientation

abstract: We study the problem of learning to assign a characteristic pose, i.e., scale and orientation, for an image region of interest. Despite its apparent simplicity, the problem is non-trivial; it is hard to obtain a large-scale set of image regions with explicit pose annotations that a model directly learns from. To tackle the issue, we propose a self-supervised learning framework with a histogram alignment technique. It generates pairs of image patches by random rescaling/rotating and then train an estimator to predict their scale/orientation values so that their relative difference is consistent with the rescaling/rotating used. The estimator learns to predict a non-parametric histogram distribution of scale/orientation without any supervision. Experiments show that it significantly outperforms previous methods in scale/orientation estimation and also improves image matching and 6 DoF camera pose estimation by incorporating our patch poses into a matching process.


title: On Enforcing Better Conditioned Meta-Learning for Rapid Few-Shot Adaptation

abstract: Inspired by the concept of preconditioning, we propose a novel method to increase adaptation speed for gradient-based meta-learning methods without incurring extra parameters. We demonstrate that recasting the optimization problem to a non-linear least-squares formulation provides a principled way to actively enforce a $\textit{well-conditioned}$ parameter space for meta-learning models based on the concepts of the condition number and local curvature. Our comprehensive evaluations show that the proposed method significantly outperforms its unconstrained counterpart especially during initial adaptation steps, while achieving comparable or better overall results on several few-shot classification tasks -- creating the possibility of dynamically choosing the number of adaptation steps at inference time.


title: Latency Control for Keyword Spotting

abstract: Conversational agents commonly utilize keyword spotting (KWS) to initiate voice interaction with the user. For user experience and privacy considerations, existing approaches to KWS largely focus on accuracy, which can often come at the expense of introduced latency. To address this tradeoff, we propose a novel approach to control KWS model latency and which generalizes to any loss function without explicit knowledge of the keyword endpoint. Through a single, tunable hyperparameter, our approach enables one to balance detection latency and accuracy for the targeted application. Empirically, we show that our approach gives superior performance under latency constraints when compared to existing methods. Namely, we make a substantial 25\% relative false accepts improvement for a fixed latency target when compared to the baseline state-of-the-art. We also show that when our approach is used in conjunction with a max-pooling loss, we are able to improve relative false accepts by 25 % at a fixed latency when compared to cross entropy loss.


title: Products of manifolds with fibered corners

abstract: Manifolds with fibered corners arise as resolutions of stratified spaces, in many body compactifications of vector spaces, moduli spaces, and other settings. We define a category of fibered corners manifolds which has products and transverse fiber products, generalizing both the resolutions of products of stratified spaces and many body products, which are special cases. The product in the fibered corners category is a resolution of the cartesian product by blow-up which we call the 'ordered product'. This ordered product is a natural product for wedge (aka incomplete edge) metrics and quasi-fibered boundary metrics, a class which includes QAC and QALE metrics.


title: Contact cylindrical surfaces and a projection of a surface around a parabolic point

abstract: We investigate differential geometric properties of a parabolic point of a surface in the Euclidean three space. We introduce the contact cylindrical surface which is a cylindrical surface having a degenerate contact type with the original surface at a parabolic point. Furthermore, we show that such a contact property gives a characterization to the $\mathcal{A}$-singularity of the orthogonal projection of a surface from the asymptotic direction.


title: Born for Auto-Tagging: Faster and better with new objective functions

abstract: Keyword extraction is a task of text mining. It is applied to increase search volume in SEO and ads. Implemented in auto-tagging, it makes tagging on a mass scale of online articles and photos efficiently and accurately. BAT is invented for auto-tagging which served as awoo's AI marketing platform (AMP). awoo AMP not only provides service as a customized recommender system but also increases the converting rate in E-commerce. The strength of BAT converges faster and better than other SOTA models, as its 4-layer structure achieves the best F scores at 50 epochs. In other words, it performs better than other models which require deeper layers at 100 epochs. To generate rich and clean tags, awoo creates new objective functions to maintain similar ${\rm F_1}$ scores with cross-entropy while enhancing ${\rm F_2}$ scores simultaneously. To assure the even better performance of F scores awoo revamps the learning rate strategy proposed by Transformer \cite{Transformer} to increase ${\rm F_1}$ and ${\rm F_2}$ scores at the same time.


title: On the Hilbert-type operators acting from function spaces into sequence spaces

abstract: In this paper we introduce and study some Hilbert-type operators acting from the function spaces into the sequence spaces. We give some sufficient and necessary conditions for the boundedness and compactness of these Hilbert-type operators. Also, for some special cases, we obtain the sharp estimates for the norms of certain Hilbert-type operators.


title: Deployment of AGRI-BOT in Greenhouse Administration

abstract: Modern agriculture is constantly evolving to increase production despite unfavorable environmental conditions. A promising approach is 'greenhouse cultivation' providing a microclimate to the cultivated plants to overcome unfavorable climate. However, massive-sized greenhouses develop non-uniform micro-climate throughout the complex requiring high degree of human supervision. We propose deploying an Agri-Bot to create and maintain positive ecological conditions in the greenhouse, reducing labor costs and increasing production. The prototype will contain two primary systems, the navigation system and the data analytics system. The navigation system will be controlled by an Arduino, and data analytics will be handled using an ESP8266 microchip. Numerous sensors for measuring the greenhouse parameters will be mounted on the robot. It will follow a predefined path, while taking readings at checkpoints. The microchip will collect and process data from sensors, transmit to the cloud, and give commands to the actuators. The soil and climate parameters like temperature, humidity, light intensity, soil moisture, pH will be measured periodically. When the parameters are not within a specified range, the Agri-Bot will take corrective actions like switching on blowers/heaters, starting irrigation etc. If external intervention is required, eg., fertilizer, it will indicate accordingly. Deploying such an Agri-Bot for monitoring and controlling microclimate in large-scale greenhouses can mitigate labor costs while increasing productivity. In spite of an initial cost, it can provide a high return on investment by providing flexibility, low power consumption and easy management to help greenhouse be water efficient, provide evenly dispersed and controlled sunlight intensity, temperature and humidity.


title: Rethinking Generalization in Few-Shot Classification

abstract: Single image-level annotations only correctly describe an often small subset of an image's content, particularly when complex real-world scenes are depicted. While this might be acceptable in many classification scenarios, it poses a significant challenge for applications where the set of classes differs significantly between training and test time. In this paper, we take a closer look at the implications in the context of $\textit{few-shot learning}$. Splitting the input samples into patches and encoding these via the help of Vision Transformers allows us to establish semantic correspondences between local regions across images and independent of their respective class. The most informative patch embeddings for the task at hand are then determined as a function of the support set via online optimization at inference time, additionally providing visual interpretability of `$\textit{what matters most}$' in the image. We build on recent advances in unsupervised training of networks via masked image modelling to overcome the lack of fine-grained labels and learn the more general statistical structure of the data while avoiding negative image-level annotation influence, $\textit{aka}$ supervision collapse. Experimental results show the competitiveness of our approach, achieving new state-of-the-art results on four popular few-shot classification benchmarks for $5$-shot and $1$-shot scenarios.


title: A semiparametric probability distribution estimator of sample maximums

abstract: Several approaches of nonparametric inference for extreme values have been studied. This study surveys the semiparametric probability distribution estimation of sample maximums. Moriyama (2021) clarified that the parametric fitting to the generalized extreme value distribution becomes large as the tail becomes light, which means the convergence becomes slow. Moriyama (2021) proposed a nonparametric distribution estimator without the fitting of the distribution and obtained asymptotic properties. The nonparametric estimator was proved to outperform the parametrically fitting estimator for light-tailed data. Moreover, it was demonstrated that the parametric fitting estimator numerically outperformed the nonparametric one in other cases. Motivated by the study, we construct two types of semiparametric distribution estimators of sample maximums. The proposed distribution estimators are constructed by mixing the two distribution estimators presented in Moriyama (2021). The cross-validation method and the maximum-likelihood method are presented as a way of estimating the optimal mixing ratio. Simulation experiments clarify the numerical properties of the two types of semiparametric distribution estimators.


title: Resource-Constrained Edge AI with Early Exit Prediction

abstract: By leveraging the data sample diversity, the early-exit network recently emerges as a prominent neural network architecture to accelerate the deep learning inference process. However, intermediate classifiers of the early exits introduce additional computation overhead, which is unfavorable for resource-constrained edge artificial intelligence (AI). In this paper, we propose an early exit prediction mechanism to reduce the on-device computation overhead in a device-edge co-inference system supported by early-exit networks. Specifically, we design a low-complexity module, namely the Exit Predictor, to guide some distinctly "hard" samples to bypass the computation of the early exits. Besides, considering the varying communication bandwidth, we extend the early exit prediction mechanism for latency-aware edge inference, which adapts the prediction thresholds of the Exit Predictor and the confidence thresholds of the early-exit network via a few simple regression models. Extensive experiment results demonstrate the effectiveness of the Exit Predictor in achieving a better tradeoff between accuracy and on-device computation overhead for early-exit networks. Besides, compared with the baseline methods, the proposed method for latency-aware edge inference attains higher inference accuracy under different bandwidth conditions.


title: Drag of an elliptic intruder in a two-dimensional granular environment

abstract: The drag of an elliptic intruder in a two-dimensional granular environment is numerically studied. The movement parallel to the major axis of the intruder is found to be unstable. The drag law is given by the sum of the yield force and the dynamic term, the latter of which is approximately reproduced by a simple collision model. The flow field around the intruder for sufficiently larger drag force is well fitted by the streamlines obtained from the perfect fluid. The stress fields around the intruder are also investigated when the movement of the intruder is balanced with interactions with the surrounding particles. The Airy stress function is found to well reproduce the stress fields once the stress on the surface of the intruder is given.


title: Human heuristics for AI-generated language are flawed

abstract: Human communication is increasingly intermixed with language generated by AI. Across chat, email, and social media, AI systems suggest words, complete sentences, or produce entire conversations. AI-generated language is often not identified as such but presented as language written by humans, raising concerns about novel forms of deception and manipulation. Here, we study how humans discern whether verbal self-presentations, one of the most personal and consequential forms of language, were generated by AI. In six experiments, participants (N = 4,600) were unable to detect self-presentations generated by state-of-the-art AI language models in professional, hospitality, and dating contexts. A computational analysis of language features shows that human judgments of AI-generated language are hindered by intuitive but flawed heuristics such as associating first-person pronouns, use of contractions, or family topics with human-written language. We experimentally demonstrate that these heuristics make human judgment of AI-generated language predictable and manipulable, allowing AI systems to produce text perceived as "more human than human." We discuss solutions, such as AI accents, to reduce the deceptive potential of language generated by AI, limiting the subversion of human intuition.


title: Machine vision for vial positioning detection toward the safe automation of material synthesis

abstract: Although robot-based automation in chemistry laboratories can accelerate the material development process, surveillance-free environments may lead to dangerous accidents primarily due to machine control errors. Object detection techniques can play vital roles in addressing these safety issues; however, state-of-the-art detectors, including single-shot detector (SSD) models, suffer from insufficient accuracy in environments involving complex and noisy scenes. With the aim of improving safety in a surveillance-free laboratory, we report a novel deep learning (DL)-based object detector, namely, DenseSSD. For the foremost and frequent problem of detecting vial positions, DenseSSD achieved a mean average precision (mAP) over 95% based on a complex dataset involving both empty and solution-filled vials, greatly exceeding those of conventional detectors; such high precision is critical to minimizing failure-induced accidents. Additionally, DenseSSD was observed to be highly insensitive to the environmental changes, maintaining its high precision under the variations of solution colors or testing view angles. The robustness of DenseSSD would allow the utilized equipment settings to be more flexible. This work demonstrates that DenseSSD is useful for enhancing safety in an automated material synthesis environment, and it can be extended to various applications where high detection accuracy and speed are both needed.


title: Parton model description of quark and antiquark correlators and TMDs

abstract: Model studies play an important role for the understanding and elucidation of the nonperturbative properties of transverse momentum dependent parton distribution functions (TMDs). The parton model is often a helpful framework and starting point for first explorations of TMD properties and the description of deep-inelastic processes in which TMDs can be accessed. Based on a systematic exploration of the parton model concept, we reconcile the claims in literature that there are 2 independent structures in the quark correlator in the parton model vs the claim that there are 3, and explain the underlying assumptions leading to the different conclusions. We also systematically explore the antiquark correlator and, to the best of our knowledge, for the first time derive the model expressions for all T-even leading and subleading antiquark TMDs. We demonstrate the consistency of the framework which can be generalized in future studies for more sophisticated TMD modelling.


title: Computational Analysis of Impedance Transformations for Four-Wire Power Networks with Sparse Neutral Grounding

abstract: In low-voltage distribution networks, the integration of novel energy technologies can be accelerated through advanced optimization-based analytics such as network state estimation and network-constrained dispatch engines for distributed energy resources. The scalability of distribution network optimization models is challenging due to phase unbalance and neutral voltage rise effects necessitating the use of 4 times as many voltage variables per bus than in transmission systems. This paper proposes a novel technique to limit this to a factor 3, exploiting common physical features of low-voltage networks specifically, where neutral grounding is sparse, as it is in many parts of the world. We validate the proposed approach in OpenDSS, by translating a number of published test cases to the reduced form, and observe that the proposed "phase-to-neutral" transformation is highly accurate for the common single-grounded low-voltage network configuration, and provides a high-quality approximation for other configurations. We finally provide numerical results for unbalanced power flow optimization problems using PowerModelsDistribution.jl, to illustrate the computational speed benefits of a factor of about 1.42.


title: CARD: Classification and Regression Diffusion Models

abstract: Learning the distribution of a continuous or categorical response variable $\boldsymbol y$ given its covariates $\boldsymbol x$ is a fundamental problem in statistics and machine learning. Deep neural network-based supervised learning algorithms have made great progress in predicting the mean of $\boldsymbol y$ given $\boldsymbol x$, but they are often criticized for their ability to accurately capture the uncertainty of their predictions. In this paper, we introduce classification and regression diffusion (CARD) models, which combine a denoising diffusion-based conditional generative model and a pre-trained conditional mean estimator, to accurately predict the distribution of $\boldsymbol y$ given $\boldsymbol x$. We demonstrate the outstanding ability of CARD in conditional distribution prediction with both toy examples and real-world datasets, the experimental results on which show that CARD in general outperforms state-of-the-art methods, including Bayesian neural network-based ones that are designed for uncertainty estimation, especially when the conditional distribution of $\boldsymbol y$ given $\boldsymbol x$ is multi-modal. In addition, we utilize the stochastic nature of the generative model outputs to obtain a finer granularity in model confidence assessment at the instance level for classification tasks.


title: Two-Timescale Optimization for Intelligent Reflecting Surface-Assisted MIMO Transmission in Fast-Changing Channels

abstract: The application of intelligent reflecting surface (IRS) depends on the knowledge of channel state information (CSI), and has been hindered by the heavy overhead of channel training, estimation, and feedback in fast-changing channels. This paper presents a new two-timescale beamforming approach to maximizing the average achievable rate (AAR) of IRS-assisted MIMO systems, where the IRS is configured relatively infrequently based on statistical CSI (S-CSI) and the base station precoder and power allocation are updated frequently based on quickly outdated instantaneous CSI (I-CSI). The key idea is that we first reveal the optimal small-timescale power allocation based on outdated I-CSI yields a water-filling structure. Given the optimal power allocation, a new mini-batch sampling (mbs)- based particle swarm optimization (PSO) algorithm is developed to optimize the large-timescale IRS configuration with reduced channel samples. Another important aspect is that we develop a model-driven PSO algorithm to optimize the IRS configuration, which maximizes a lower bound of the AAR by only using the S-CSI and eliminates the need of channel samples. The modeldriven PSO serves as a dependable lower bound for the mbs-PSO. Simulations corroborate the superiority of the new two-timescale beamforming strategy to its alternatives in terms of the AAR and efficiency, with the benefits of the IRS demonstrated.


title: A Gift from Label Smoothing: Robust Training with Adaptive Label Smoothing via Auxiliary Classifier under Label Noise

abstract: As deep neural networks can easily overfit noisy labels, robust training in the presence of noisy labels is becoming an important challenge in modern deep learning. While existing methods address this problem in various directions, they still produce unpredictable sub-optimal results since they rely on the posterior information estimated by the feature extractor corrupted by noisy labels. Lipschitz regularization successfully alleviates this problem by training a robust feature extractor, but it requires longer training time and expensive computations. Motivated by this, we propose a simple yet effective method, called ALASCA, which efficiently provides a robust feature extractor under label noise. ALASCA integrates two key ingredients: (1) adaptive label smoothing based on our theoretical analysis that label smoothing implicitly induces Lipschitz regularization, and (2) auxiliary classifiers that enable practical application of intermediate Lipschitz regularization with negligible computations. We conduct wide-ranging experiments for ALASCA and combine our proposed method with previous noise-robust methods on several synthetic and real-world datasets. Experimental results show that our framework consistently improves the robustness of feature extractors and the performance of existing baselines with efficiency. Our code is available at https://github.com/jongwooko/ALASCA.


title: Nebula Graph: An open source distributed graph database

abstract: This paper introduces the recent work of Nebula Graph, an open-source, distributed, scalable, and native graph database. We present a system design trade-off and a comprehensive overview of Nebula Graph internals, including graph data models, partitioning strategies, secondary indexes, optimizer rules, storage-side transactions, graph query languages, observability, graph processing frameworks, and visualization tool-kits. In addition, three sets of large-scale graph b


title: Global Convergence of Federated Learning for Mixed Regression

abstract: This paper studies the problem of model training under Federated Learning when clients exhibit cluster structure. We contextualize this problem in mixed regression, where each client has limited local data generated from one of $k$ unknown regression models. We design an algorithm that achieves global convergence from any initialization, and works even when local data volume is highly unbalanced -- there could exist clients that contain $O(1)$ data points only. Our algorithm first runs moment descent on a few anchor clients (each with $\tilde{\Omega}(k)$ data points) to obtain coarse model estimates. Then each client alternately estimates its cluster labels and refines the model estimates based on FedAvg or FedProx. A key innovation in our analysis is a uniform estimate on the clustering errors, which we prove by bounding the VC dimension of general polynomial concept classes based on the theory of algebraic geometry.


title: ERNAS: An Evolutionary Neural Architecture Search for Magnetic Resonance Image Reconstructions

abstract: Magnetic resonance imaging (MRI) is one of the noninvasive imaging modalities that can produce high-quality images. However, the scan procedure is relatively slow, which causes patient discomfort and motion artifacts in images. Accelerating MRI hardware is constrained by physical and physiological limitations. A popular alternative approach to accelerated MRI is to undersample the k-space data. While undersampling speeds up the scan procedure, it generates artifacts in the images, and advanced reconstruction algorithms are needed to produce artifact-free images. Recently deep learning has emerged as a promising MRI reconstruction method to address this problem. However, straightforward adoption of the existing deep learning neural network architectures in MRI reconstructions is not usually optimal in terms of efficiency and reconstruction quality. In this work, MRI reconstruction from undersampled data was carried out using an optimized neural network using a novel evolutionary neural architecture search algorithm. Brain and knee MRI datasets show that the proposed algorithm outperforms manually designed neural network-based MR reconstruction models.


title: Super-resolution image display using diffractive decoders

abstract: High-resolution synthesis/projection of images over a large field-of-view (FOV) is hindered by the restricted space-bandwidth-product (SBP) of wavefront modulators. We report a deep learning-enabled diffractive display design that is based on a jointly-trained pair of an electronic encoder and a diffractive optical decoder to synthesize/project super-resolved images using low-resolution wavefront modulators. The digital encoder, composed of a trained convolutional neural network (CNN), rapidly pre-processes the high-resolution images of interest so that their spatial information is encoded into low-resolution (LR) modulation patterns, projected via a low SBP wavefront modulator. The diffractive decoder processes this LR encoded information using thin transmissive layers that are structured using deep learning to all-optically synthesize and project super-resolved images at its output FOV. Our results indicate that this diffractive image display can achieve a super-resolution factor of ~4, demonstrating a ~16-fold increase in SBP. We also experimentally validate the success of this diffractive super-resolution display using 3D-printed diffractive decoders that operate at the THz spectrum. This diffractive image decoder can be scaled to operate at visible wavelengths and inspire the design of large FOV and high-resolution displays that are compact, low-power, and computationally efficient.

categories: physics.optics cs.CV cs.NE physics.app-ph


title: Human Eyes Inspired Recurrent Neural Networks are More Robust Against Adversarial Noises

abstract: Compared to human vision, computer vision based on convolutional neural networks (CNN) are more vulnerable to adversarial noises. This difference is likely attributable to how the eyes sample visual input and how the brain processes retinal samples through its dorsal and ventral visual pathways, which are under-explored for computer vision. Inspired by the brain, we design recurrent neural networks, including an input sampler that mimics the human retina, a dorsal network that guides where to look next, and a ventral network that represents the retinal samples. Taking these modules together, the models learn to take multiple glances at an image, attend to a salient part at each glance, and accumulate the representation over time to recognize the image. We test such models for their robustness against a varying level of adversarial noises with a special focus on the effect of different input sampling strategies. Our findings suggest that retinal foveation and sampling renders a model more robust against adversarial noises, and the model may correct itself from an attack when it is given a longer time to take more glances at an image. In conclusion, robust visual recognition can benefit from the combined use of three brain-inspired mechanisms: retinal transformation, attention guided eye movement, and recurrent processing, as opposed to feedforward-only CNNs.


title: Semisimplicity of \'etale cohomology of certain Shimura varieties

abstract: Building on work of Fayad and Nekov\'{a}\v{r}, we show that a certain part of the etale cohomology of some abelian-type Shimura varieties is semisimple, assuming the associated automorphic Galois representations exists, and satisfies some good properties. The proof combines an abstract semisimplicity criterion of Fayad-Nekov\'{a}\v{r} with the Eichler-Shimura relations.


title: A Survey on Gradient Inversion: Attacks, Defenses and Future Directions

abstract: Recent studies have shown that the training samples can be recovered from gradients, which are called Gradient Inversion (GradInv) attacks. However, there remains a lack of extensive surveys covering recent advances and thorough analysis of this issue. In this paper, we present a comprehensive survey on GradInv, aiming to summarize the cutting-edge research and broaden the horizons for different domains. Firstly, we propose a taxonomy of GradInv attacks by characterizing existing attacks into two paradigms: iteration- and recursion-based attacks. In particular, we dig out some critical ingredients from the iteration-based attacks, including data initialization, model training and gradient matching. Second, we summarize emerging defense strategies against GradInv attacks. We find these approaches focus on three perspectives covering data obscuration, model improvement and gradient protection. Finally, we discuss some promising directions and open problems for further research.


title: Engineering the phase-robust topological router in a chiral-symmetric dimerized superconducting circuit lattice with long-range hopping

abstract: We propose a scheme to implement the phase-robust topological router based on a one-dimensional dimerized superconducting circuit lattice with long-range hopping. We show that the proposed dimerized superconducting circuit lattice can be mapped into an extended chiral-symmetric Su-Schrieffer-Heeger (SSH) model with long-range hopping, in which the existence of long-range hopping induces a special zero-energy mode. The peculiar distribution of the zero-energy mode enables us to engineer a phase-robust topological router, which can achieve quantum state transfer (QST) from one site (input port) to multiple sites (output ports). Benefiting from the topological protection of chiral symmetry, we demonstrate that the presence of the mild disorder in nearest-neighbor and long-range hopping has no appreciable effects on QST in the lattice. Especially, after introducing another new long-range hopping into the extended SSH lattice, we propose an optimized protocol of the phase-robust topological router, in which the number of the output ports can be efficiently increased. Resorting to the Bose statistical properties of the superconducting circuit lattice, the input port and output ports assisted by the zero-energy mode can be detected via the mean distribution of the photons. Our work breaks the traditional QST form with only one outport by the zero-energy mode and opens a pathway to construct large-scale quantum information processing in the SSH chains with long-range hopping.


title: Faster Decomposition of Weighted Graphs into Cliques using Fisher's Inequality

abstract: Mining groups of genes that consistently co-express is an important problem in biomedical research, where it is critical for applications such as drug-repositioning and designing new disease treatments. Recently, Cooley et al. modeled this problem as Exact Weighted Clique Decomposition (EWCD) in which, given an edge-weighted graph $G$ and a positive integer $k$, the goal is to decompose $G$ into at most $k$ (overlapping) weighted cliques so that an edge's weight is exactly equal to the sum of weights for cliques it participates in. They show EWCD is fixed-parameter-tractable, giving a $4^k$-kernel alongside a backtracking algorithm (together called cricca) to iteratively build a decomposition. Unfortunately, because of inherent exponential growth in the space of potential solutions, cricca is typically able to decompose graphs only when $k \leq 11$. In this work, we establish reduction rules that exponentially decrease the size of the kernel (from $4^k$ to $k2^k$) for EWCD. In addition, we use insights about the structure of potential solutions to give new search rules that speed up the decomposition algorithm. At the core of our techniques is a result from combinatorial design theory called Fisher's inequality characterizing set systems with restricted intersections. We deploy our kernelization and decomposition algorithms (together called DeCAF) on a corpus of biologically-inspired data and obtain over two orders of magnitude speed-up over cricca. As a result, DeCAF scales to instances with $k \geq 17$.


title: Characterizing and Mitigating the Impact of Telluric Absorption in Precise Radial Velocities

abstract: Precise radial velocity (PRV) surveys are important for the search of Earth analogs around nearby bright stars. Such planets induce a small stellar reflex motion with RV amplitude of $\sim$10 cm/s. Detecting such a small RV signal poses important challenges to instrumentation, data analysis, and the precision of astrophysical models to mitigate stellar jitter. In this work, we investigate an important component in the PRV error budget - the spectral contamination from the Earth's atmosphere (tellurics). We characterize the effects of telluric absorption on the RV precision and quantify its contribution to the RV budget over time and across a wavelength range of 350 nm - 2.5$\mu$m. We investigate the effectiveness in mitigating tellurics using simulated spectra of a solar twin star with telluric contamination over a year's worth of observations, and we extracted the RVs using two commonly adopted algorithms: dividing out a telluric model before performing cross-correlation or Forward Modeling the observed spectrum incorporating a telluric model. We assume various degrees of cleanness in removing the tellurics, including mimicking the lack of accurate knowledge of the telluric lines by using a mismatched line profile to model the "observed" tellurics. We conclude that the RV errors caused by telluric absorption can be suppressed to close to or even below the photon-limited precision in the optical region, especially in the blue, around 1-10 cm/s. At red through near-infrared wavelengths, however, the residuals of tellurics can induce an RV error on the m/s level even under the most favorable assumptions for telluric removal, leading to significant systematic noise in the RV time series and periodograms. If the red-optical or near-infrared becomes critical in the mitigation of stellar activity, systematic errors from tellurics can be eliminated with a space mission such as EarthFinder.


title: Streaming non-autoregressive model for any-to-many voice conversion

abstract: Voice conversion models have developed for decades, and current mainstream research focuses on non-streaming voice conversion. However, streaming voice conversion is more suitable for practical application scenarios than non-streaming voice conversion. In this paper, we propose a streaming any-to-many voice conversion based on fully non-autoregressive model, which includes a streaming transformer based acoustic model and a streaming vocoder. Streaming transformer based acoustic model is composed of a pre-trained encoder from streaming end-to-end based automatic speech recognition model and a decoder modified on FastSpeech blocks. Streaming vocoder is designed for streaming task with pseudo quadrature mirror filter bank and causal convolution. Experimental results show that the proposed method achieves significant performance both in latency and conversion quality and can be real-time on CPU and GPU.


title: Text-Aware End-to-end Mispronunciation Detection and Diagnosis

abstract: Mispronunciation detection and diagnosis (MDD) technology is a key component of computer-assisted pronunciation training system (CAPT). In the field of assessing the pronunciation quality of constrained speech, the given transcriptions can play the role of a teacher. Conventional methods have fully utilized the prior texts for the model construction or improving the system performance, e.g. forced-alignment and extended recognition networks. Recently, some end-to-end based methods attempt to incorporate the prior texts into model training and preliminarily show the effectiveness. However, previous studies mostly consider applying raw attention mechanism to fuse audio representations with text representations, without taking possible text-pronunciation mismatch into account. In this paper, we present a gating strategy that assigns more importance to the relevant audio features while suppressing irrelevant text information. Moreover, given the transcriptions, we design an extra contrastive loss to reduce the gap between the learning objective of phoneme recognition and MDD. We conducted experiments using two publicly available datasets (TIMIT and L2-Arctic) and our best model improved the F1 score from $57.51\%$ to $61.75\%$ compared to the baselines. Besides, we provide a detailed analysis to shed light on the effectiveness of gating mechanism and contrastive learning on MDD.


title: Differentiable Top-k Classification Learning

abstract: The top-k classification accuracy is one of the core metrics in machine learning. Here, k is conventionally a positive integer, such as 1 or 5, leading to top-1 or top-5 training objectives. In this work, we relax this assumption and optimize the model for multiple k simultaneously instead of using a single k. Leveraging recent advances in differentiable sorting and ranking, we propose a differentiable top-k cross-entropy classification loss. This allows training the network while not only considering the top-1 prediction, but also, e.g., the top-2 and top-5 predictions. We evaluate the proposed loss function for fine-tuning on state-of-the-art architectures, as well as for training from scratch. We find that relaxing k does not only produce better top-5 accuracies, but also leads to top-1 accuracy improvements. When fine-tuning publicly available ImageNet models, we achieve a new state-of-the-art for these models.


title: Infrared acceleration radiation

abstract: We present an exactly soluble electron trajectory that permits an analysis of the soft (deep infrared) radiation emitted, the existence of which has been experimentally observed during beta decay via lowest order inner bremsstrahlung. Our treatment also predicts the time evolution and temperature of the emission, and possibly the spectrum, by analogy with the closely related phenomenon of the dynamic Casimir effect.


title: Mitigating radio frequency interference in CHIME/FRB real-time intensity data

abstract: Extragalactic fast radio bursts (FRBs) are a new class of astrophysical transients with unknown origins that have become a main focus of radio observatories worldwide. FRBs are highly energetic ($\sim 10^{36}$-$10^{42}$ ergs) flashes that last for about a millisecond. Thanks to its broad bandwidth (400-800 MHz), large field of view ($\sim$200 sq. deg.), and massive data rate (1500 TB of coherently beamformed data per day), the Canadian Hydrogen Intensity Mapping Experiment / Fast Radio Burst (CHIME/FRB) project has increased the total number of discovered FRBs by over a factor 10 in 3 years of operation. CHIME/FRB observations are hampered by the constant exposure to radio frequency interference (RFI) from artificial devices (e.g., cellular phones, aircraft), resulting in $\sim$20% loss of bandwidth. In this work, we describe our novel technique for mitigating RFI in CHIME/FRB real-time intensity data. We mitigate RFI through a sequence of iterative operations, which mask out statistical outliers from frequency-channelized intensity data that have been effectively high-pass filtered. Keeping false positive and false negative rates at very low levels, our approach is useful for any high-performance surveys of radio transients in the future.


title: FRCRN: Boosting Feature Representation using Frequency Recurrence for Monaural Speech Enhancement

abstract: Convolutional recurrent networks (CRN) integrating a convolutional encoder-decoder (CED) structure and a recurrent structure have achieved promising performance for monaural speech enhancement. However, feature representation across frequency context is highly constrained due to limited receptive fields in the convolutions of CED. In this paper, we propose a convolutional recurrent encoder-decoder (CRED) structure to boost feature representation along the frequency axis. The CRED applies frequency recurrence on 3D convolutional feature maps along the frequency axis following each convolution, therefore, it is capable of catching long-range frequency correlations and enhancing feature representations of speech inputs. The proposed frequency recurrence is realized efficiently using a feedforward sequential memory network (FSMN). Besides the CRED, we insert two stacked FSMN layers between the encoder and the decoder to model further temporal dynamics. We name the proposed framework as Frequency Recurrent CRN (FRCRN). We design FRCRN to predict complex Ideal Ratio Mask (cIRM) in complex-valued domain and optimize FRCRN using both time-frequency-domain and time-domain losses. Our proposed approach achieved state-of-the-art performance on wideband benchmark datasets and achieved 2nd place for the real-time fullband track in terms of Mean Opinion Score (MOS) and Word Accuracy (WAcc) in the ICASSP 2022 Deep Noise Suppression (DNS) challenge (https://github.com/alibabasglab/FRCRN).


title: Hyperfine fields at $^{66}$Ga, $^{67,69}$Ge implanted into iron and gadolinium hosts at 6 K, and applications to g-factor measurements

abstract: Isomers in $^{66}$Ga, $^{67}$Ge, and $^{69}$Ge were recoil-implanted into ferromagnetic hosts of iron and gadolinium at $\approx 6$~K, and the hyperfine magnetic fields were determined by Time Differential Perturbed Angular Distribution (TDPAD) measurements. The hyperfine field strengths at $\approx 6$~K are compared to the results of previous higher-temperature measurements and the amplitudes of the $R(t)$ functions are compared to empirical expectations. The results show that gadolinium can be a suitable host for high-precision in-beam $g$-factor measurements. The results of new $g$-factor measurements for isomers in $^{66}$Ga and $^{67}$Ge are $g(^{66}$Ga$,7^{-}) = +0.126(4)$, supporting a $[\pi_{f5/2} \otimes \nu g_{9/2}]_{7^-}$ configuration assignment, and $g(^{67}$Ge$,\frac{9}{2}^{+})=-0.1932(22)$, derived from a new measurement of the ratio $g(^{67}\mathrm{Ge})/g(^{69}\mathrm{Ge}) = 0.869(9)$. These values are in agreement with previous results. The $R(t)$ amplitudes indicate that the nuclear alignment produced in the isomeric states was significantly lower than the empirically expected $\sigma/I \approx 0.35$.


title: FOLD-TR: A Scalable and Efficient Inductive Learning Algorithm for Learning To Rank

abstract: FOLD-R++ is a new inductive learning algorithm for binary classification tasks. It generates an (explainable) normal logic program for mixed type (numerical and categorical) data. We present a customized FOLD-R++ algorithm with the ranking framework, called FOLD-TR, that aims to rank new items following the ranking pattern in the training data. Like FOLD-R++, the FOLD-TR algorithm is able to handle mixed-type data directly and provide native justification to explain the comparison between a pair of items.


title: Enhanced Knowledge Selection for Grounded Dialogues via Document Semantic Graphs

abstract: Providing conversation models with background knowledge has been shown to make open-domain dialogues more informative and engaging. Existing models treat knowledge selection as a sentence ranking or classification problem where each sentence is handled individually, ignoring the internal semantic connection among sentences in the background document. In this work, we propose to automatically convert the background knowledge documents into document semantic graphs and then perform knowledge selection over such graphs. Our document semantic graphs preserve sentence-level information through the use of sentence nodes and provide concept connections between sentences. We jointly apply multi-task learning for sentence-level and concept-level knowledge selection and show that it improves sentence-level selection. Our experiments show that our semantic graph-based knowledge selection improves over sentence selection baselines for both the knowledge selection task and the end-to-end response generation task on HollE and improves generalization on unseen topics in WoW.


title: Buckling behavior of tenary one-dimensional van der Waals heterostructures

abstract: 1D van der Waals heterostructures (1D vdWH) were recently reported to be successfully synthesized. We perform molecular dynamics simulations to investigate the buckling behavior of a 1D vdWH composed of inner carbon nanotube, a middle boron nitride nanotube and an outer molybdenum disulfide nanotube. We find that as the temperature increases, the 1D vdWH gradully loses its stability and the peak value of compressive stress decreases. Slenderness ratio have a slight influence on the strength and stability of 1D vdWH under axial compression.


title: S$^2$-FPN: Scale-ware Strip Attention Guided Feature Pyramid Network for Real-time Semantic Segmentation

abstract: Modern high-performance semantic segmentation methods employ a heavy backbone and dilated convolution to extract the relevant feature. Although extracting features with both contextual and semantic information is critical for the segmentation tasks, it brings a memory footprint and high computation cost for real-time applications. This paper presents a new model to achieve a trade-off between accuracy/speed for real-time road scene semantic segmentation. Specifically, we proposed a lightweight model named Scale-aware Strip Attention Guided Feature Pyramid Network (S$^2$-FPN). Our network consists of three main modules: Attention Pyramid Fusion (APF) module, Scale-aware Strip Attention Module (SSAM), and Global Feature Upsample (GFU) module. APF adopts an attention mechanisms to learn discriminative multi-scale features and help close the semantic gap between different levels. APF uses the scale-aware attention to encode global context with vertical stripping operation and models the long-range dependencies, which helps relate pixels with similar semantic label. In addition, APF employs channel-wise reweighting block (CRB) to emphasize the channel features. Finally, the decoder of S$^2$-FPN then adopts GFU, which is used to fuse features from APF and the encoder. Extensive experiments have been conducted on two challenging semantic segmentation benchmarks, which demonstrate that our approach achieves better accuracy/speed trade-off with different model settings. The proposed models have achieved a results of 76.2\%mIoU/87.3FPS, 77.4\%mIoU/67FPS, and 77.8\%mIoU/30.5FPS on Cityscapes dataset, and 69.6\%mIoU,71.0\% mIoU, and 74.2\% mIoU on Camvid dataset. The code for this work will be made available at \url{https://github.com/mohamedac29/S2-FPN


title: Deformed spin-$\frac12$ square lattice in antiferromagnetic NaZnVOPO$_4$(HPO$_4$)

abstract: We report the structural and magnetic properties of a new spin-$\frac12$ antiferromagnet NaZnVOPO$_4$(HPO$_4$) studied via x-ray diffraction, magnetic susceptibility, high-field magnetization, specific heat, and $^{31}$P nuclear magnetic resonance (NMR) measurements, as well as density-functional band-structure calculations. While thermodynamic properties of this compound are well described by the $J_1-J_2$ square-lattice model, \textit{ab initio} calculations suggest a significant deformation of the spin lattice. From fits to the magnetic susceptibility we determine the averaged nearest-neighbor and second-neighbor exchange couplings of $\bar J_1\simeq -1.3$ K and $\bar J_2\simeq 5.6$ K, respectively. Experimental saturation field of 15.3\,T is consistent with these estimates if 20\% spatial anisotropy in $J_1$ is taken into account. Specific heat data signal the onset of a magnetic long-range order at $T_{\rm N} \simeq 2.1$ K, which is further supported by a sharp peak in the NMR spin-lattice relaxation rate. The NMR spectra mark the superposition of two P lines due to two noneqivalent P sites where the broad line with the strong hyperfine coupling and short $T_1$ is identified as the P(1) site located within the magnetic planes, while the narrow line with the weak hyperfine coupling and long $T_1$ is designated as the P(2) site located between the planes.


title: From Outcome-Based to Language-Based Preferences

abstract: We review the literature on models that try to explain human behavior in social interactions described by normal-form games with monetary payoffs. We start by covering social and moral preferences. We then focus on the growing body of research showing that people react to the language in which actions are described, especially when it activates moral concerns. We conclude by arguing that behavioral economics is in the midst of a paradigm shift towards language-based preferences, which will require an exploration of new models and experimental setups.


title: Quantum transport in a one-dimensional quasicrystal with mobility edges

abstract: Quantum transport in a one-dimensional (1D) quasiperiodic lattice with mobility edges is explored. We first investigate the adiabatic pumping between left and right edge modes by resorting to two edge-bulk-edge channels and demonstrate that the success or failure of the adiabatic pumping depends on whether the corresponding bulk subchannel undergoes a localization-delocalization transition. Compared with the paradigmatic Aubry-Andr\'e (AA) model, the introduction of mobility edges triggers an opposite outcome for successful pumping in the two channels, showing a discrepancy of critical condition, and facilitates the robustness of the adiabatic pumping against quasidisorder. We also consider the transfer between excitations at both boundaries of the lattice and an anomalous phenomenon characterized by the enhanced quasidisorder contributing to the excitation transfer is found. Furthermore, there exists a parametric regime where a nonreciprocal effect emerges in the presence of mobility edges, which leads to a unidirectional transport for the excitation transfer and enables potential applications in the engineering of quantum diodes.


title: Surface-oxygen-passivation driven large anomalous Hall conductivity (AHC) in nitride MXenes: Can AHC be a tool to determine functional groups in 2D ferro(i)magnets?

abstract: Identifying the existence of specific functional groups in MXenes is a difficult topic that has perplexed researchers for a long time. We show in this paper that in the case of magnetic MXenes, the magneto-transport properties of the material provide an easy solution. One of the fascinating properties that MXenes offer is the realization of intrinsic ferromagnetism which is important for two-dimensional (2D) materials family. The previous reports have only made a few statements on some MXenes citing its usefulness for spintronics related applications. Here, using first-principle calculations we have examined the actual magneto-transport phenomena in MXenes family. We have considered all possible combinations of 3\textit{d} transition metals ($Ti, V, Cr$ and $Mn$) and nitride based functionalized $(O_2, F_2$ and $(OH)_2$) MXenes, $M_2NT_2$. The intrinsic anomalous Hall effect is investigated in $Cr$ and $Mn$ based MXenes as the compounds possess ground state stable ferromagnetic solutions. We demonstrate that intrinsic Anomalous Hall conductivity (AHC) can be used to identify the functional groups in MXenes. Additionally, half-metallic features of these ferromagnetic MXenes make them potential candidates for varieties of applications such as in logic and memory devices, quantum computations, spintronics etc. The maximum anomalous Hall conductivity (AHC) at Fermi energy, $E_F$, is found in case of $Mn_2NO_2$ (470 $S/cm$) which is attributed to the presence of avoided band crossing and larger density of states. Together, when considered all the studied systems, the AHC can be above 2500 $S/cm$ within $E_F \pm $ 0.25 $eV$. Our findings could be useful not only in guiding the experimentalists by considering AHC as a simple tool in determining the functional groups in 2D ferro(i)magnets, also, it could be useful in designing memory device with negligible stray fields.


title: Energetic Variational Neural Network Discretizations of Gradient Flows

abstract: We present a structure-preserving Eulerian algorithm for solving $L^2$-gradient flows and a structure-preserving Lagrangian algorithm for solving generalized diffusions. Both algorithms employ neural networks as tools for spatial discretization. Unlike most existing methods that construct numerical discretizations based on the strong or weak form of the underlying PDE, the proposed schemes are constructed based on the energy-dissipation law directly. This guarantees the monotonic decay of the system's free energy, which avoids unphysical states of solutions and is crucial for the long-term stability of numerical computations. To address challenges arising from nonlinear neural network discretization, we perform temporal discretizations on these variational systems before spatial discretizations. This approach is computationally memory-efficient when implementing neural network-based algorithms. The proposed neural network-based schemes are mesh-free, allowing us to solve gradient flows in high dimensions. Various numerical experiments are presented to demonstrate the accuracy and energy stability of the proposed numerical schemes.


title: Knowledge Management System with NLP-Assisted Annotations: A Brief Survey and Outlook

abstract: Knowledge management systems (KMS) are in high demand for industrial researchers, chemical or research enterprises, or evidence-based decision making. However, existing systems have limitations in categorizing and organizing paper insights or relationships. Traditional databases are usually disjoint with logging systems, which limit its utility in generating concise, collated overviews. In this work, we briefly survey existing approaches of this problem space and propose a unified framework that utilizes relational databases to log hierarchical information to facilitate the research and writing process, or generate useful knowledge from references or insights from connected concepts. Our framework of bidirectional knowledge management system (BKMS) enables novel functionalities encompassing improved hierarchical note-taking, AI-assisted brainstorming, and multi-directional relationships. Potential applications include managing inventories and changes for manufacture or research enterprises, or generating analytic reports with evidence-based decision making.


title: Diffusion Transport Alignment

abstract: The integration of multimodal data presents a challenge in cases when the study of a given phenomena by different instruments or conditions generates distinct but related domains. Many existing data integration methods assume a known one-to-one correspondence between domains of the entire dataset, which may be unrealistic. Furthermore, existing manifold alignment methods are not suited for cases where the data contains domain-specific regions, i.e., there is not a counterpart for a certain portion of the data in the other domain. We propose Diffusion Transport Alignment (DTA), a semi-supervised manifold alignment method that exploits prior correspondence knowledge between only a few points to align the domains. By building a diffusion process, DTA finds a transportation plan between data measured from two heterogeneous domains with different feature spaces, which by assumption, share a similar geometrical structure coming from the same underlying data generating process. DTA can also compute a partial alignment in a data-driven fashion, resulting in accurate alignments when some data are measured in only one domain. We empirically demonstrate that DTA outperforms other methods in aligning multimodal data in this semisupervised setting. We also empirically show that the alignment obtained by DTA can improve the performance of machine learning tasks, such as domain adaptation, inter-domain feature mapping, and exploratory data analysis, while outperforming competing methods.


title: The Frequency and Mass-Ratio Distribution of Binaries in Clusters I: Description of the method and application to M67

abstract: We present a new method for probabilistic generative modelling of stellar colour-magnitude diagrams (CMDs) to infer the frequency of binary stars and their mass-ratio distribution. The method invokes a mixture model to account for overlapping populations of single stars, binaries and outliers in the CMD. We apply the model to Gaia observations of the old open cluster, M67, and find a frequency $f_B(q > 0.5) = 0.258 \pm 0.019$ for binary stars with mass ratio greater than 0.5. The form of the mass-ratio distribution function rises towards higher mass ratios for $q > 0.3$.


title: VCT: A Video Compression Transformer

abstract: We show how transformers can be used to vastly simplify neural video compression. Previous methods have been relying on an increasing number of architectural biases and priors, including motion prediction and warping operations, resulting in complex models. Instead, we independently map input frames to representations and use a transformer to model their dependencies, letting it predict the distribution of future representations given the past. The resulting video compression transformer outperforms previous methods on standard video compression data sets. Experiments on synthetic data show that our model learns to handle complex motion patterns such as panning, blurring and fading purely from data. Our approach is easy to implement, and we release code to facilitate future research.


title: Cost-Aware Exploration for Chiplet-Based Architecture with Advanced Packaging Technologies

abstract: The chiplet-based System-in-Package~(SiP) technology enables more design flexibility via various inter-chiplet connection and heterogeneous integration. However, it is not known how to convert such flexibility into cost efficiency, which is critical when making a design decision. In this paper, we develop an analytical cost model that can estimate the cost of the 2.5D chiplet-based SiP systems under various interconnection options and technology nodes. We conducted two case studies using our cost model to explore the cost characteristics of the 2.5D chiplet-based SiP system. Based on the case studies, we made several observations on the interposer selection, design partition granularity, and technology node adoption for cost-efficient chiplet-based SiP design.


title: Estimating the Optimal Covariance with Imperfect Mean in Diffusion Probabilistic Models

abstract: Diffusion probabilistic models (DPMs) are a class of powerful deep generative models (DGMs). Despite their success, the iterative generation process over the full timesteps is much less efficient than other DGMs such as GANs. Thus, the generation performance on a subset of timesteps is crucial, which is greatly influenced by the covariance design in DPMs. In this work, we consider diagonal and full covariances to improve the expressive power of DPMs. We derive the optimal result for such covariances, and then correct it when the mean of DPMs is imperfect. Both the optimal and the corrected ones can be decomposed into terms of conditional expectations over functions of noise. Building upon it, we propose to estimate the optimal covariance and its correction given imperfect mean by learning these conditional expectations. Our method can be applied to DPMs with both discrete and continuous timesteps. We consider the diagonal covariance in our implementation for computational efficiency. For an efficient practical implementation, we adopt a parameter sharing scheme and a two-stage training process. Empirically, our method outperforms a wide variety of covariance design on likelihood results, and improves the sample quality especially on a small number of timesteps.


title: Filter-Bank-Enabled Leaky-Wave Antenna Array Technique for Full-Band-Locked Radar System in Stitched Frequency-Space Domain

abstract: Inspired by the filter-bank (FB) concept that is normally used for multi-rate signal processing, an FB-enabled array technique of leaky-wave antennas (LWAs) is proposed and studied for creating full-band-locked frequency-scanning radar (FSR) systems in a stitched frequency-space domain. This is mainly for addressing the coupling dilemma between the range and angle resolutions, which is historically and naturally inherited from a conventional FSR. First of all, the frequency-modulated continuous-wave system architecture is selected to exemplify and recall the characteristics of a conventional FSR with an emphasis on that resolution coupling. Then, a radar solution featuring a stitched frequency-space domain is introduced for the resolution decoupling, depending on an array of FB-enabled LWA channels. With the radar equation, FB-related conditions for realizing the critical frequency-space stitching are analytically derived and equivalently converted into several design specifications of an array of LWAs, i.e., engineered beam-scanning functions, beam-crossovers, and phase alignments. To facilitate the practical implementation of such an array technique, a detailed and generalized design flow is developed. Finally, for a simple proof of concept, an FB-enabled two-channel LWA array is modeled, fabricated, and measured. Simulated and measured results are in a reasonable agreement, and both demonstrate the desired frequency-space stitching behavior, i.e., enhanced spectrum bandwidth and widened radiation beamwidth. The proposed array solution may be potentially deployed for FSR systems with a full-band-locked beam illumination and a decoupled range-angle resolution, which may present a competitor against the phased array technique.


title: Can pruning improve certified robustness of neural networks?

abstract: With the rapid development of deep learning, the sizes of neural networks become larger and larger so that the training and inference often overwhelm the hardware resources. Given the fact that neural networks are often over-parameterized, one effective way to reduce such computational overhead is neural network pruning, by removing redundant parameters from trained neural networks. It has been recently observed that pruning can not only reduce computational overhead but also can improve empirical robustness of deep neural networks (NNs), potentially owing to removing spurious correlations while preserving the predictive accuracies. This paper for the first time demonstrates that pruning can generally improve certified robustness for ReLU-based NNs under the complete verification setting. Using the popular Branch-and-Bound (BaB) framework, we find that pruning can enhance the estimated bound tightness of certified robustness verification, by alleviating linear relaxation and sub-domain split problems. We empirically verify our findings with off-the-shelf pruning methods and further present a new stability-based pruning method tailored for reducing neuron instability, that outperforms existing pruning methods in enhancing certified robustness. Our experiments show that by appropriately pruning an NN, its certified accuracy can be boosted up to 8.2% under standard training, and up to 24.5% under adversarial training on the CIFAR10 dataset. We additionally observe the existence of certified lottery tickets that can match both standard and certified robust accuracies of the original dense models across different datasets. Our findings offer a new angle to study the intriguing interaction between sparsity and robustness, i.e. interpreting the interaction of sparsity and certified robustness via neuron stability. Codes are available at: https://github.com/VITA-Group/CertifiedPruning.


title: Bott-Chern cohomology of compact Vaisman manifolds

abstract: We give an explicit description of the Bott-Chern cohomology groups of a compact Vaisman manifold in terms of the basic cohomology. We infer that the Bott-Chern numbers and the Dolbeault numbers of a Vaisman manifold determine each other. On the other hand, we show that the cohomological invariants $\Delta^k$ introduced by Angella-Tomassini are unbounded for Vaisman manifolds. Finally, we give a cohomological characterization of the Dolbeault and Bott-Chern formality for Vaisman metrics.


title: Quantum computing for transport optimization

abstract: We explore the near-term intersection of quantum computing with the transport sector. To support near-term integration, we introduce a framework for assessing the suitability of transport optimization problems for obtaining potential performance enhancement using quantum algorithms. Given a suitable problem, we then present a workflow for obtaining valuable transport solutions using quantum computers, articulate the limitations on contemporary systems, and describe newly available performance-enhancing tools applicable to current commercial quantum computing systems. We make this integration process concrete by following the assessment framework and integration workflow for an exemplary vehicle routing optimization problem: the Capacitated Vehicle Routing Problem. We present novel advances to exponentially reduce the required computational resources, and experimentally demonstrate a prototype implementation exhibiting over 20X circuit performance enhancement on a real quantum device.


title: Fast and Reliable Evaluation of Adversarial Robustness with Minimum-Margin Attack

abstract: The AutoAttack (AA) has been the most reliable method to evaluate adversarial robustness when considerable computational resources are available. However, the high computational cost (e.g., 100 times more than that of the project gradient descent attack) makes AA infeasible for practitioners with limited computational resources, and also hinders applications of AA in the adversarial training (AT). In this paper, we propose a novel method, minimum-margin (MM) attack, to fast and reliably evaluate adversarial robustness. Compared with AA, our method achieves comparable performance but only costs 3% of the computational time in extensive experiments. The reliability of our method lies in that we evaluate the quality of adversarial examples using the margin between two targets that can precisely identify the most adversarial example. The computational efficiency of our method lies in an effective Sequential TArget Ranking Selection (STARS) method, ensuring that the cost of the MM attack is independent of the number of classes. The MM attack opens a new way for evaluating adversarial robustness and provides a feasible and reliable way to generate high-quality adversarial examples in AT.


title: Semi-analytical theory of emission and transport in a LAFE-based diode

abstract: A large area field emitter (LAFE) typically consists of several thousands of nanoscale emitting tips. These are difficult to simulate using purely numerical methods based on finite/boundary element or finite difference methods. We show here that a semi-analytically obtained electrostatic field allows tracking of field emitted electrons of a LAFE fairly accurately using the knowledge of only the LAFE geometry. Using a single and a 9-emitter configuration, the beam parameters calculated using this method are compared with the results of tracking using fields generated by COMSOL. The net emission current, energy conservation and the transverse trace-emittance are found to be reproduced with reasonable accuracy.

categories: physics.app-ph cond-mat.mes-hall physics.acc-ph physics.plasm-ph


title: Online Contextual Decision-Making with a Smart Predict-then-Optimize Method

abstract: We study an online contextual decision-making problem with resource constraints. At each time period, the decision-maker first predicts a reward vector and resource consumption matrix based on a given context vector and then solves a downstream optimization problem to make a decision. The final goal of the decision-maker is to maximize the summation of the reward and the utility from resource consumption, while satisfying the resource constraints. We propose an algorithm that mixes a prediction step based on the "Smart Predict-then-Optimize (SPO)" method with a dual update step based on mirror descent. We prove regret bounds and demonstrate that the overall convergence rate of our method depends on the $\mathcal{O}(T^{-1/2})$ convergence of online mirror descent as well as risk bounds of the surrogate loss function used to learn the prediction model. Our algorithm and regret bounds apply to a general convex feasible region for the resource constraints, including both hard and soft resource constraint cases, and they apply to a wide class of prediction models in contrast to the traditional settings of linear contextual models or finite policy spaces. We also conduct numerical experiments to empirically demonstrate the strength of our proposed SPO-type methods, as compared to traditional prediction-error-only methods, on multi-dimensional knapsack and longest path instances.


title: Pulsational instability of pre-main-sequence models from accreting protostars II. Modelling echelle diagrams of $\delta$ Scuti stars without rotational splitting

abstract: The physics of early stellar evolution (e.g. accretion processes) is often not properly included in the calculations of pre-main-sequence models, leading to insufficient model grids and hence systematic errors in the results. We aim to investigate current and improved approaches for the asteroseismic modelling of pre-main-sequence delta Scuti stars. We calculated an extensive grid of pre-main-sequence models including the early accretion phase and used the resulting equilibrium models as input to calculate theoretical frequency spectra. These spectra were used to investigate different approaches in modelling echelle diagrams to find the most reliable methods. By applying Petersen diagrams, we present a simple algorithm to extract echelle diagrams from observed pulsation frequencies. We show that model grids with insufficient input physics and imperfect modelling approaches lead to underestimated uncertainties and systematic errors in the extracted stellar parameters. Our re-discussion of HD 139614 leads to different stellar parameters than the ones derived by Murphy et al. (2021). We performed a model comparison between this previous investigation and our results by applying the Akaike and Bayesian information criteria. While the results with regard to our 10-d model are inconclusive, they show (very) strong evidence of a 6-d model with fixed accretion parameters (leading to almost identical stellar parameters to those of the 10-d model) to be preferred over the model applied by Murphy et al. (2021). In general, our modelling approach can provide narrow constraints on the stellar parameters (\Delta R ~ 0.05 R_\odot, \Delta log g <~ 0.01, and \Delta M_\star ~ 0.1 M_\odot). The extensively tested modelling approaches and automatic extraction of echelle diagrams should allow us to study many more pre-main-sequence delta Scuti stars in the future and lead to reliable stellar parameters.


title: CMNEROne at SemEval-2022 Task 11: Code-Mixed Named Entity Recognition by leveraging multilingual data

abstract: Identifying named entities is, in general, a practical and challenging task in the field of Natural Language Processing. Named Entity Recognition on the code-mixed text is further challenging due to the linguistic complexity resulting from the nature of the mixing. This paper addresses the submission of team CMNEROne to the SEMEVAL 2022 shared task 11 MultiCoNER. The Code-mixed NER task aimed to identify named entities on the code-mixed dataset. Our work consists of Named Entity Recognition (NER) on the code-mixed dataset by leveraging the multilingual data. We achieved a weighted average F1 score of 0.7044, i.e., 6% greater than the baseline.


title: Toward the smooth mesh climbing of a miniature robot using bioinspired soft and expandable claws

abstract: While most micro-robots face difficulty traveling on rugged and uneven terrain, beetles can walk smoothly on the complex substrate without slipping or getting stuck on the surface due to their stiffness-variable tarsi and expandable hooks on the tip of tarsi. In this study, we found that beetles actively bent and expanded their claws regularly to crawl freely on mesh surfaces. Inspired by the crawling mechanism of the beetles, we designed an 8-cm miniature climbing robot equipping artificial claws to open and bend in the same cyclic manner as natural beetles. The robot can climb freely with a controllable gait on the mesh surface, steep incline of the angle of 60{\deg}, and even transition surface. To our best knowledge, this is the first micro-scale robot that can climb both the mesh surface and cliffy incline.


title: Mackey-type identity for invariant functions on Lie algebras of finite unitary groups and an application

abstract: The Mackey-type identity mentioned in the title relates the operations of parabolic induction and restriction for invariant functions on the Lie algebras of the finite unitary groups $U(N, q^2)$. This result is applied to constructing positive harmonic functions on a new branching graph with a negative Hall-Littlewood parameter, as introduced in the authors' paper [Adv. Math. vol. 395 (2022), 108087; arXiv:2102.01947].This in turn implies the existence of an infinite-parameter family of invariant measures for the coadjoint action of an infinite-dimensional analogue of the groups $U(N, q^2)$.


title: Morphence-2.0: Evasion-Resilient Moving Target Defense Powered by Out-of-Distribution Detection

abstract: Evasion attacks against machine learning models often succeed via iterative probing of a fixed target model, whereby an attack that succeeds once will succeed repeatedly. One promising approach to counter this threat is making a model a moving target against adversarial inputs. To this end, we introduce Morphence-2.0, a scalable moving target defense (MTD) powered by out-of-distribution (OOD) detection to defend against adversarial examples. By regularly moving the decision function of a model, Morphence-2.0 makes it significantly challenging for repeated or correlated attacks to succeed. Morphence-2.0 deploys a pool of models generated from a base model in a manner that introduces sufficient randomness when it responds to prediction queries. Via OOD detection, Morphence-2.0 is equipped with a scheduling approach that assigns adversarial examples to robust decision functions and benign samples to an undefended accurate models. To ensure repeated or correlated attacks fail, the deployed pool of models automatically expires after a query budget is reached and the model pool is seamlessly replaced by a new model pool generated in advance. We evaluate Morphence-2.0 on two benchmark image classification datasets (MNIST and CIFAR10) against 4 reference attacks (3 white-box and 1 black-box). Morphence-2.0 consistently outperforms prior defenses while preserving accuracy on clean data and reducing attack transferability. We also show that, when powered by OOD detection, Morphence-2.0 is able to precisely make an input-based movement of the model's decision function that leads to higher prediction accuracy on both adversarial and benign queries.


title: Anomalous Ettingshausen effect in iron-carbon alloys

abstract: We have investigated the anomalous Ettingshausen effect (AEE) in iron-carbon alloys, i.e., cast irons and steel, using the lock-in thermography. All the alloys exhibit the clear AEE-induced temperature modulation, and their anomalous Ettingshausen coefficient is an order of magnitude greater than that of the pure iron at room temperature. The dimensionless figure of merit for AEE in the ductile cast iron is 55 times greater than that in the pure iron owing to the significant increase of the anomalous Ettingshausen coefficient. Our result reveals a potential of iron-carbon alloys as transverse thermoelectric materials, although the composition and microstructures optimizations are necessary.


title: A Continuous Risk Assessment Methodology for Cloud Infrastructures

abstract: Cloud systems are dynamic environments which make it difficult to keep track of security risks that resources are exposed to. Traditionally, risk assessment is conducted for individual assets to evaluate existing threats; their results, however, are quickly outdated in such a dynamic environment. In this paper, we propose an adaptation of the traditional risk assessment methodology for cloud infrastructures which loosely couples manual, in-depth analyses with continuous, automatic application of their results. These two parts are linked by a novel threat profile definition that allows to reusably describe configuration weaknesses based on properties that are common across assets and cloud providers. This way, threats can be identified automatically for all resources that exhibit the same properties, including new and modified ones. We also present a prototype implementation which automatically evaluates an infrastructure as code template of a cloud system against a set of threat profiles, and we evaluate its performance. Our methodology not only enables organizations to reuse their threat analysis results, but also to collaborate on their development, e.g. with the public community. To that end, we propose an initial open-source repository of threat profiles.


title: Advection of Accelerated Electrons in Radio/X-ray Knots of AGN Jets

abstract: The X-ray emission from the knots of the kilo-parsec scale jet of active galactic nuclei (AGN) suggests the high energy emission process is different from the radio/optical counterpart. Interpretation based on the Inverse Compton scattering of cosmic microwave photons has been ruled out through Fermi gamma-ray observations for low redshift sources. As an alternate explanation, synchrotron emission from a different electron population is suggested. We propose a model considering the advected electron distribution from the sites of particle acceleration in AGN knots. This advected electron distribution is significantly different from the accelerated electron distribution and satisfies the requirement of the second electron population. The synchrotron emission from the accelerated and the advected electron distribution can successfully reproduce the observed radio to X-ray fluxes of the knots of 3C 273. For the chosen combination of the model parameters, the spectrum due to inverse Compton scattering of cosmic microwave photons falls within the Fermi gamma-ray upper limits.


title: Second order stabilized semi-implicit scheme for the Cahn-Hilliard model with dynamic boundary conditions

abstract: We study the numerical algorithm and error analysis for the Cahn-Hilliard equation with dynamic boundary conditions. A second-order in time, linear and energy stable scheme is proposed, which is an extension of the first-order stabilized approach. The corresponding energy stability and convergence analysis of the scheme are derived theoretically. Some numerical experiments are performed to verify the effectiveness and accuracy of the second-order numerical scheme, including numerical simulations under various initial conditions and energy potential functions, and comparisons with the literature works.


title: Recent Advances in Scene Image Representation and Classification

abstract: With the rise of deep learning algorithms nowadays, scene image representation methods have achieved a significant performance boost in classification. However, the performance is still limited because the scene images are mostly complex having higher intra-class dissimilarity and inter-class similarity problems. To deal with such problems, there have been several methods proposed in the literature with their advantages and limitations. A detailed study of previous works is necessary to understand their advantages and disadvantages in image representation and classification problems. In this paper, we review the existing scene image representation methods that are being widely used for image classification. For this, we, first, devise the taxonomy using the seminal existing methods proposed in the literature to this date {using deep learning (DL)-based, computer vision (CV)-based, and search engine (SE)-based methods}. Next, we compare their performance both qualitatively (e.g., quality of outputs, pros/cons, etc.) and quantitatively (e.g., accuracy). Last, we speculate on the prominent research directions in scene image representation tasks using {keyword growth and timeline analysis.} Overall, this survey provides in-depth insights and applications of recent scene image representation methods under three different methods.


title: Exploiting Cross-domain And Cross-Lingual Ultrasound Tongue Imaging Features For Elderly And Dysarthric Speech Recognition

abstract: Articulatory features are inherently invariant to acoustic signal distortion and have been successfully incorporated into automatic speech recognition (ASR) systems designed for normal speech. Their practical application to atypical task domains such as elderly and disordered speech across languages is often limited by the difficulty in collecting such specialist data from target speakers. This paper presents a cross-domain and cross-lingual A2A inversion approach that utilizes the parallel audio and ultrasound tongue imaging (UTI) data of the 24-hour TaL corpus in A2A model pre-training before being cross-domain and cross-lingual adapted to three datasets across two languages: the English DementiaBank Pitt and Cantonese JCCOCC MoCA elderly speech corpora; and the English TORGO dysarthric speech data, to produce UTI based articulatory features. Experiments conducted on three tasks suggested incorporating the generated articulatory features consistently outperformed the baseline TDNN and Conformer ASR systems constructed using acoustic features only by statistically significant word or character error rate reductions up to 4.75%, 2.59% and 2.07% absolute (14.69%, 10.64% and 22.72% relative) after data augmentation, speaker adaptation and cross system multi-pass decoding were applied.


title: A Survey : Neural Networks for AMR-to-Text

abstract: AMR-to-text is one of the key techniques in the NLP community that aims at generating sentences from the Abstract Meaning Representation (AMR) graphs. Since AMR was proposed in 2013, the study on AMR-to-Text has become increasingly prevalent as an essential branch of structured data to text because of the unique advantages of AMR as a high-level semantic description of natural language. In this paper, we provide a brief survey of AMR-to-Text. Firstly, we introduce the current scenario of this technique and point out its difficulties. Secondly, based on the methods used in previous studies, we roughly divided them into five categories according to their respective mechanisms, i.e., Rules-based, Seq-to-Seq-based, Graph-to-Seq-based, Transformer-based, and Pre-trained Language Model (PLM)-based. In particular, we detail the neural network-based method and present the latest progress of AMR-to-Text, which refers to AMR reconstruction, Decoder optimization, etc. Furthermore, we present the benchmarks and evaluation methods of AMR-to-Text. Eventually, we provide a summary of current techniques and the outlook for future research.


title: Application-Oriented Selection of Privacy Enhancing Technologies

abstract: To create privacy-friendly software designs, architects need comprehensive knowledge of existing privacy-enhancing technologies (PETs) and their properties. Existing works that systemize PETs, however, are outdated or focus on comparison criteria rather than providing guidance for their practical selection. In this short paper we present an enhanced classification of PETs that is more application-oriented than previous proposals. It integrates existing criteria like the privacy protection goal, and also considers practical criteria like the functional context, a technology's maturity, and its impact on various non-functional requirements. We expect that our classification simplifies the selection of PETs for experts and non-experts.


title: Diffuse spin waves, zero modes and cluster excitations in the spin-3/2 kagom\'e antiferromagnet chromium jarosite, KCr$_3$(OD)$_6$(SO$_4$)$_2$

abstract: The dynamics of the S = 3=2 kagome antiferromagnet chromium jarosite, KCr$_3$(OD)$_6$(SO$_4$)$_2$ was studied using high-resolution neutron time-of-flight spectroscopy on a polycrystalline sample with a nearly stoichiometric magnetic lattice (2.8(2)% Cr vacancies). Neutron spectroscopy reveals diffuse spin wave excitations in the ordered phase with an incomplete gap and significant finite life-time broadening as well as a pronounced zero mode. Using linear spin wave theory, we estimate the exchange couplings, with the leading nearest neighbor value being $J_1$ = 0:884 meV. Above $T_N$ diffuse excitations from cooperative paramagnetism dominate. A model for two-dimensional magnetic cluster excitations is shown to capture the essential features of the data in the cooperative paramagnetic phase.


title: ETMA: Efficient Transformer Based Multilevel Attention framework for Multimodal Fake News Detection

abstract: In this new digital era, social media has created a severe impact on the lives of people. In recent times, fake news content on social media has become one of the major challenging problems for society. The dissemination of fabricated and false news articles includes multimodal data in the form of text and images. The previous methods have mainly focused on unimodal analysis. Moreover, for multimodal analysis, researchers fail to keep the unique characteristics corresponding to each modality. This paper aims to overcome these limitations by proposing an Efficient Transformer based Multilevel Attention (ETMA) framework for multimodal fake news detection, which comprises the following components: visual attention-based encoder, textual attention-based encoder, and joint attention-based learning. Each component utilizes the different forms of attention mechanism and uniquely deals with multimodal data to detect fraudulent content. The efficacy of the proposed network is validated by conducting several experiments on four real-world fake news datasets: Twitter, Jruvika Fake News Dataset, Pontes Fake News Dataset, and Risdal Fake News Dataset using multiple evaluation metrics. The results show that the proposed method outperforms the baseline methods on all four datasets. Further, the computation time of the model is also lower than the state-of-the-art methods.