title: Forest density is more effective than tree rigidity at reducing the onshore energy flux of tsunamis: Evidence from Large Eddy Simulations with Fluid-Structure Interactions

abstract: Communities around the world are increasingly interested in nature-based solutions to mitigation of coastal risks like coastal forests, but it remains unclear how much protective benefits vegetation provides, particularly in the limit of highly energetic flows after tsunami impact. The current study, using a three-dimensional incompressible computational fluid dynamics model with a fluid-structure interaction approach, aims to quantify how energy reflection and dissipation vary with different degrees of rigidity and vegetation density of a coastal forest. We represent tree trunks as cylinders and use the elastic modulus of hardwood trees such as pine or oak to characterize the rigidity of these cylinders. The numerical results show that energy reflection increases with rigidity only for a single cylinder. In the presence of multiple cylinders, the difference in energy reflection created by varying rigidity diminishes as the number of cylinders increases. Instead of rigidity, we find that the blockage area created by the presence of multiple tree trunks dominates energy reflection. As tree trunks are deformed by the hydrodynamic forces, they alter the flow field around them, causing turbulent kinetic energy generation in the wake region. As a consequence, trees dissipate flow energy, highlighting coastal forests reducing the onshore energy flux of tsunamis by means of both reflection and dissipation.


title: Improved Heat and Particle Flux Mitigation in High Core Confinement, Baffled, Alternate Divertor Configurations in the TCV tokamak

abstract: Nitrogen seeded detachment has been achieved in the Tokamak a Configuration Variable (TCV) in advanced divertor configurations (ADCs), namely X-divertor and X-point target, with and without baffles in H-mode plasmas with high core confinement. Both ADCs show a remarkable reduction in the inter-ELM particle and heat fluxes to the target compared to the standard divertor configuration. 95-98% of the peak heat flux to the target is mitigated as a synergetic effect of ADCs, baffling, and nitrogen seeded detachment. The effect of divertor geometry and baffles on core-divertor compatibility is investigated in detail. The power balance in these experiments is also investigated to explore the physics behind the observed reduction in heat fluxes in the ADCs.


title: Object-ABN: Learning to Generate Sharp Attention Maps for Action Recognition

abstract: In this paper we propose an extension of the Attention Branch Network (ABN) by using instance segmentation for generating sharper attention maps for action recognition. Methods for visual explanation such as Grad-CAM usually generate blurry maps which are not intuitive for humans to understand, particularly in recognizing actions of people in videos. Our proposed method, Object-ABN, tackles this issue by introducing a new mask loss that makes the generated attention maps close to the instance segmentation result. Further the PC loss and multiple attention maps are introduced to enhance the sharpness of the maps and improve the performance of classification. Experimental results with UCF101 and SSv2 shows that the generated maps by the proposed method are much clearer qualitatively and quantitatively than those of the original ABN.


title: Marker and source-marker reprogramming of Most Permissive Boolean networks and ensembles with BoNesis

abstract: Boolean networks (BNs) are discrete dynamical systems with applications to the modeling of cellular behaviors. In this paper, we demonstrate how the software BoNesis can be employed to exhaustively identify combinations of perturbations which enforce properties on their fixed points and attractors. We consider marker properties, which specify that some components are fixed to a specific value. We study 4 variants of the marker reprogramming problem: the reprogramming of fixed points, of minimal trap spaces, and of fixed points and minimal trap spaces reachable from a given initial configuration with the most permissive update mode. The perturbations consist of fixing a set of components to a fixed value. They can destroy and create new attractors. In each case, we give an upper bound on their theoretical computational complexity, and give an implementation of the resolution using the BoNesis Python framework. Finally, we lift the reprogramming problems to ensembles of BNs, as supported by BoNesis, bringing insight on possible and universal reprogramming strategies. This paper can be executed and modified interactively.


title: Arbitrary unitary rotation of three-dimensional pixellated images

abstract: Using the coefficients introduced by Bargmann and Moshinsky for the reduction of the su($3$) algebra of Cartesian three-dimensional oscillator multiplet states into so($3$) angular momentum submultiplets, we implement unitary rotations of three-dimensional Cartesian arrays that form finite pixellated "volume images." Transforming between the Cartesian and spherical bases, the subgroup of rotations in the latter is converted into rotations of the former, allowing for proper concatenation and inversion of these unitary transformations, which entail no loss of information.


title: Federated Selective Aggregation for Knowledge Amalgamation

abstract: In this paper, we explore a new knowledge-amalgamation problem, termed Federated Selective Aggregation (FedSA). The goal of FedSA is to train a student model for a new task with the help of several decentralized teachers, whose pre-training tasks and data are different and agnostic. Our motivation for investigating such a problem setup stems from a recent dilemma of model sharing. Many researchers or institutes have spent enormous resources on training large and competent networks. Due to the privacy, security, or intellectual property issues, they are, however, not able to share their own pre-trained models, even if they wish to contribute to the community. The proposed FedSA offers a solution to this dilemma and makes it one step further since, again, the learned student may specialize in a new task different from all of the teachers. To this end, we proposed a dedicated strategy for handling FedSA. Specifically, our student-training process is driven by a novel saliency-based approach that adaptively selects teachers as the participants and integrates their representative capabilities into the student. To evaluate the effectiveness of FedSA, we conduct experiments on both single-task and multi-task settings. Experimental results demonstrate that FedSA effectively amalgamates knowledge from decentralized models and achieves competitive performance to centralized baselines.


title: Learning the Evolution of Correlated Stochastic Power System Dynamics

abstract: A machine learning technique is proposed for quantifying uncertainty in power system dynamics with spatiotemporally correlated stochastic forcing. We learn one-dimensional linear partial differential equations for the probability density functions of real-valued quantities of interest. The method is suitable for high-dimensional systems and helps to alleviate the curse of dimensionality.

categories: cs.LG math.DS math.PR physics.data-an stat.AP


title: JDRec: Practical Actor-Critic Framework for Online Combinatorial Recommender System

abstract: A combinatorial recommender (CR) system feeds a list of items to a user at a time in the result page, in which the user behavior is affected by both contextual information and items. The CR is formulated as a combinatorial optimization problem with the objective of maximizing the recommendation reward of the whole list. Despite its importance, it is still a challenge to build a practical CR system, due to the efficiency, dynamics, personalization requirement in online environment. In particular, we tear the problem into two sub-problems, list generation and list evaluation. Novel and practical model architectures are designed for these sub-problems aiming at jointly optimizing effectiveness and efficiency. In order to adapt to online case, a bootstrap algorithm forming an actor-critic reinforcement framework is given to explore better recommendation mode in long-term user interaction. Offline and online experiment results demonstrate the efficacy of proposed JDRec framework. JDRec has been applied in online JD recommendation, improving click through rate by 2.6% and synthetical value for the platform by 5.03%. We will publish the large-scale dataset used in this study to contribute to the research community.


title: Searching for Regularity in Bounded Functions

abstract: Given a function $f$ on $\mathbb{F}_2^n$, we study the following problem. What is the largest affine subspace $\mathcal{U}$ such that when restricted to $\mathcal{U}$, all the non-trivial Fourier coefficients of $f$ are very small? For the natural class of bounded Fourier degree $d$ functions $f:\mathbb{F}_2^n \to [-1,1]$, we show that there exists an affine subspace of dimension at least $ \tilde\Omega(n^{1/d!}k^{-2})$, wherein all of $f$'s nontrivial Fourier coefficients become smaller than $ 2^{-k}$. To complement this result, we show the existence of degree $d$ functions with coefficients larger than $2^{-d\log n}$ when restricted to any affine subspace of dimension larger than $\Omega(dn^{1/(d-1)})$. In addition, we give explicit examples of functions with analogous but weaker properties. Along the way, we provide multiple characterizations of the Fourier coefficients of functions restricted to subspaces of $\mathbb{F}_2^n$ that may be useful in other contexts. Finally, we highlight applications and connections of our results to parity kill number and affine dispersers.


title: Social Live-Streaming Use & Well-being: Examining Participation, Financial Commitment, Social Capital, and Psychological Well-being on Twitch.tv

abstract: This study examines how active participation, financial commitment, and passive participation in the leading social live-streaming service, Twitch.tv, relate to individuals' psychological well-being. The three dimensions of social capital-structural, relational, and cognitive-as well as parasocial relationship are explored as mediators. Cross-sectional survey data from 396 respondents was analyzed by comparing two fully saturated structural equation models. Findings indicate actively participating in a favorite streamers' Chat is positively associated with increased well-being. Structural social capital, or having more social interaction ties, positively mediates the relationship between active participation and well-being, as well as financial commitment and well-being. Greater cognitive social capital, or shared values and goals with a favorite streamer, is related to decreased well-being. Parasocial relationship does not significantly mediate the relationship between use and well-being. Our results demonstrate the importance of tangible social ties over the perceived relationships or identification with a favorite streamer.


title: Monotonicity of Markov chain transition probabilities via quasi-stationarity -- an application to Bernoulli percolation on $C_k \times Z$

abstract: Let $X_n, n \ge 0$ be a Markov chain with finite state space $M$. If $x,y \in M$ such that $x$ is transient we have $P^y(X_n = x) \to 0$ for $n \to \infty$, and under mild aperiodicity conditions this convergence is monotone in that for some $N$ we have $\forall n \ge N: P^y(X_n = x)$ $\ge P^y(X_{n+1} = x)$. We use bounds on the rate of convergence of the Markov chain to its quasi-stationary distribution to obtain explicit bounds on $N$. We then apply this result to Bernoulli percolation with parameter $p$ on the cylinder graph $C_k \times Z$. Utilizing a Markov chain describing infection patterns layer per layer, we thus show the following uniform result on the monotonicity of connection probabilities: $\forall k \ge 3\, \forall n \ge 500k^6 2^k \,\forall p \in (0,1) \, \forall m \in C_k\!\!:$ $P_p((0,0) \leftrightarrow (m,n)) \ge P_p((0,0) \leftrightarrow (m,n+1))$. In general these kind of monotonicity properties of connection probabilities are difficult to establish and there are only few pertaining results.


title: Portrait Interpretation and a Benchmark

abstract: We propose a task we name Portrait Interpretation and construct a dataset named Portrait250K for it. Current researches on portraits such as human attribute recognition and person re-identification have achieved many successes, but generally, they: 1) may lack mining the interrelationship between various tasks and the possible benefits it may bring; 2) design deep models specifically for each task, which is inefficient; 3) may be unable to cope with the needs of a unified model and comprehensive perception in actual scenes. In this paper, the proposed portrait interpretation recognizes the perception of humans from a new systematic perspective. We divide the perception of portraits into three aspects, namely Appearance, Posture, and Emotion, and design corresponding sub-tasks for each aspect. Based on the framework of multi-task learning, portrait interpretation requires a comprehensive description of static attributes and dynamic states of portraits. To invigorate research on this new task, we construct a new dataset that contains 250,000 images labeled with identity, gender, age, physique, height, expression, and posture of the whole body and arms. Our dataset is collected from 51 movies, hence covering extensive diversity. Furthermore, we focus on representation learning for portrait interpretation and propose a baseline that reflects our systematic perspective. We also propose an appropriate metric for this task. Our experimental results demonstrate that combining the tasks related to portrait interpretation can yield benefits. Code and dataset will be made public.


title: NICEST: Noisy Label Correction and Training for Robust Scene Graph Generation

abstract: Nearly all existing scene graph generation (SGG) models have overlooked the ground-truth annotation qualities of mainstream SGG datasets, i.e., they assume: 1) all the manually annotated positive samples are equally correct; 2) all the un-annotated negative samples are absolutely background. In this paper, we argue that neither of the assumptions applies to SGG: there are numerous noisy ground-truth predicate labels that break these two assumptions and harm the training of unbiased SGG models. To this end, we propose a novel NoIsy label CorrEction and Sample Training strategy for SGG: NICEST. Specifically, it consists of two parts: NICE and NIST, which rule out these noisy label issues by generating high-quality samples and the effective training strategy, respectively. NICE first detects noisy samples and then reassigns them more high-quality soft predicate labels. NIST is a multi-teacher knowledge distillation based training strategy, which enables the model to learn unbiased fusion knowledge. And a dynamic trade-off weighting strategy in NIST is designed to penalize the bias of different teachers. Due to the model-agnostic nature of both NICE and NIST, our NICEST can be seamlessly incorporated into any SGG architecture to boost its performance on different predicate categories. In addition, to better evaluate the generalization of SGG models, we further propose a new benchmark VG-OOD, by re-organizing the prevalent VG dataset and deliberately making the predicate distributions of the training and test sets as different as possible for each subject-object category pair. This new benchmark helps disentangle the influence of subject-object category based frequency biases. Extensive ablations and results on different backbones and tasks have attested to the effectiveness and generalization ability of each component of NICEST.


title: Convolutional Embedding Makes Hierarchical Vision Transformer Stronger

abstract: Vision Transformers (ViTs) have recently dominated a range of computer vision tasks, yet it suffers from low training data efficiency and inferior local semantic representation capability without appropriate inductive bias. Convolutional neural networks (CNNs) inherently capture regional-aware semantics, inspiring researchers to introduce CNNs back into the architecture of the ViTs to provide desirable inductive bias for ViTs. However, is the locality achieved by the micro-level CNNs embedded in ViTs good enough? In this paper, we investigate the problem by profoundly exploring how the macro architecture of the hybrid CNNs/ViTs enhances the performances of hierarchical ViTs. Particularly, we study the role of token embedding layers, alias convolutional embedding (CE), and systemically reveal how CE injects desirable inductive bias in ViTs. Besides, we apply the optimal CE configuration to 4 recently released state-of-the-art ViTs, effectively boosting the corresponding performances. Finally, a family of efficient hybrid CNNs/ViTs, dubbed CETNets, are released, which may serve as generic vision backbones. Specifically, CETNets achieve 84.9% Top-1 accuracy on ImageNet-1K (training from scratch), 48.6% box mAP on the COCO benchmark, and 51.6% mIoU on the ADE20K, substantially improving the performances of the corresponding state-of-the-art baselines.


title: Mode-Switching of Active Droplets in Macromolecular Solutions

abstract: Typical bodily and environmental fluids encountered by biological swimmers consist of dissolved macromolecules such as proteins and polymers, often rendering them non Newtonian. To mimic such scenarios, we investigate the motion of swimming droplets in an ambient medium doped with polymers as macromolecular solutes. Active droplets mimic the essential propulsive characteristics of several biological swimmers and serve as ideal model systems to widen our understanding of their locomotive strategies. Our experiments reveal extreme sensitivity of droplet motion to the presence of macromolecular solutes in the ambient medium. Through in-situ visualization of the self-generated chemical field around the droplet, we report unexpectedly high diffusivity of filled micelles in the presence of high molecular weight polymer solutes or macromolecules. This is attributed to the limitation of Stokes-Einstein relationship in accurately predicting micelle diffusivity due to significant size disparity between micelles and the macromolecular solute. With an increase in polymer concentration, particle image velocimetry reveals a mode-switching, from the conventional pusher mode to a puller mode of propulsion, characterized by a more persistent droplet motion. With a further increase in concentration, a secondary transition from smooth to a jittery mode of propulsion occurs. A robust Peclet number framework is proposed that successfully captures the observed mode-switching of active droplets. Our experiments unveil a novel route to orchestrate complex transitions in active droplet propulsion by doping the ambient medium with suitable choice of macromolecules.


title: Should Bank Stress Tests Be Fair?

abstract: Regulatory stress tests have become one of the main tools for setting capital requirements at the largest U.S. banks. The Federal Reserve uses confidential models to evaluate bank-specific outcomes for bank-specific portfolios in shared stress scenarios. As a matter of policy, the same models are used for all banks, despite considerable heterogeneity across institutions; individual banks have contended that some models are not suited to their businesses. Motivated by this debate, we ask, what is a fair aggregation of individually tailored models into a common model? We argue that simply pooling data across banks treats banks equally but is subject to two deficiencies: it may distort the impact of legitimate portfolio features, and it is vulnerable to implicit misdirection of legitimate information to infer bank identity. We compare various notions of regression fairness to address these deficiencies, considering both forecast accuracy and equal treatment. In the setting of linear models, we argue for estimating and then discarding centered bank fixed effects as preferable to simply ignoring differences across banks. We present evidence that the overall impact can be material. We also discuss extensions to nonlinear models.


title: Generator Knows What Discriminator Should Learn in Unconditional GANs

abstract: Recent methods for conditional image generation benefit from dense supervision such as segmentation label maps to achieve high-fidelity. However, it is rarely explored to employ dense supervision for unconditional image generation. Here we explore the efficacy of dense supervision in unconditional generation and find generator feature maps can be an alternative of cost-expensive semantic label maps. From our empirical evidences, we propose a new generator-guided discriminator regularization(GGDR) in which the generator feature maps supervise the discriminator to have rich semantic representations in unconditional generation. In specific, we employ an U-Net architecture for discriminator, which is trained to predict the generator feature maps given fake images as inputs. Extensive experiments on mulitple datasets show that our GGDR consistently improves the performance of baseline methods in terms of quantitative and qualitative aspects. Code is available at https://github.com/naver-ai/GGDR


title: DynaMarks: Defending Against Deep Learning Model Extraction Using Dynamic Watermarking

abstract: The functionality of a deep learning (DL) model can be stolen via model extraction where an attacker obtains a surrogate model by utilizing the responses from a prediction API of the original model. In this work, we propose a novel watermarking technique called DynaMarks to protect the intellectual property (IP) of DL models against such model extraction attacks in a black-box setting. Unlike existing approaches, DynaMarks does not alter the training process of the original model but rather embeds watermark into a surrogate model by dynamically changing the output responses from the original model prediction API based on certain secret parameters at inference runtime. The experimental outcomes on Fashion MNIST, CIFAR-10, and ImageNet datasets demonstrate the efficacy of DynaMarks scheme to watermark surrogate models while preserving the accuracies of the original models deployed in edge devices. In addition, we also perform experiments to evaluate the robustness of DynaMarks against various watermark removal strategies, thus allowing a DL model owner to reliably prove model ownership.


title: Chaotic time-delay signature suppression in lasers using phase-controlled dual optical feedback

abstract: We experimentally study a semiconductor laser subject to two optical feedbacks in a free space setup. We show that the time delay signature, manifesting itself in the chaotic output intensity, can be better suppressed than in a laser with single feedback. We demonstrate that the control of the feedback phase is essential to suppress the time delay signature, in contrast to the one-delay case, and that the feedback phase also impacts the chaotic bandwidth. By optimizing the feedback phase the time delay signature can be reduced by a factor of 2 while maintaining a large chaotic bandwidth.


title: Deposition of the stoichiometric coatings by reactive magnetron sputtering

abstract: The investigations of the reactive magnetron depositing of the stoichiometric coatings metal-metalloid were done. The dependences between sputtering parameters of a target and processes of plasmochemical formation on the surface of sample metal-metalloid and formations of coatings of the appropriate structure were investigated. Experimental data on stoichiometric coatings AlN, Al2O3, TiN, TiO2 is given. Features of reactive magnetron deposition and investigation results for obtaining of coatings with pregiven properties in particular for providing stability and controllability of coating deposition processes in time. Keywords: reactive magnetron sputtering, coatings, oxide, nitride compositions.


title: Diagnosing FUor-like Sources: The Parameter Space of Viscously Heated Disks in the Optical and Near-IR

abstract: FU Ori type objects (FUors) are decades-long outbursts of accretion onto young stars that are strong enough to viscously heat disks so that the disk outshines the central star. We construct models for FUor objects by calculating emission components from a steady-state viscous accretion disk, a passively-heated dusty disk, magnetospheric accretion columns, and the stellar photosphere. We explore the parameter space of the accretion rate and stellar mass to investigate implications on the optical and near-infrared spectral energy distribution and spectral lines. The models are validated by fitting to multi-wavelength photometry of three confirmed FUor objects, FU Ori, V883 Ori and HBC 722 and then comparing the predicted spectrum to observed optical and infrared spectra. The brightness ratio between the viscous disk and the stellar photosphere, $\eta$, provides an important guide for identifying viscous accretion disks, with $\eta=1$ ("transition line") and $\eta=5$ ("sufficient dominance line") marking turning points in diagnostics, evaluated here in the near-infrared. These turning points indicate the emergence and complete development of FUor-characteristic strong CO absorption, weak metallic absorption, the triangular spectral continuum shape in the $H$-band, and location in color-magnitude diagrams. Lower stellar mass $M_*$ and higher accretion rate $\dot{M}$ lead to larger $\eta$; for $M_*=0.3~{\rm M_\odot}$, $\eta=1$ corresponds to $\dot{M}=2\times10^{-7}~{\rm M_\odot}/$yr and $\eta=5$ to $\dot{M}=6\times10^{-7}~{\rm M_\odot}/$yr. The sufficient dominance line also coincides with the expected accretion rate where accreting material directly reaches the star. We discuss implications of the models on extinction diagnostics, FUor brightening timescales, viscous disks during initial protostellar growth, and eruptive young stellar objects (YSO) associated with FUors.


title: SiRi: A Simple Selective Retraining Mechanism for Transformer-based Visual Grounding

abstract: In this paper, we investigate how to achieve better visual grounding with modern vision-language transformers, and propose a simple yet powerful Selective Retraining (SiRi) mechanism for this challenging task. Particularly, SiRi conveys a significant principle to the research of visual grounding, i.e., a better initialized vision-language encoder would help the model converge to a better local minimum, advancing the performance accordingly. In specific, we continually update the parameters of the encoder as the training goes on, while periodically re-initialize rest of the parameters to compel the model to be better optimized based on an enhanced encoder. SiRi can significantly outperform previous approaches on three popular benchmarks. Specifically, our method achieves 83.04% Top1 accuracy on RefCOCO+ testA, outperforming the state-of-the-art approaches (training from scratch) by more than 10.21%. Additionally, we reveal that SiRi performs surprisingly superior even with limited training data. We also extend it to transformer-based visual grounding models and other vision-language tasks to verify the validity.


title: Point Cloud Attacks in Graph Spectral Domain: When 3D Geometry Meets Graph Signal Processing

abstract: With the increasing attention in various 3D safety-critical applications, point cloud learning models have been shown to be vulnerable to adversarial attacks. Although existing 3D attack methods achieve high success rates, they delve into the data space with point-wise perturbation, which may neglect the geometric characteristics. Instead, we propose point cloud attacks from a new perspective -- the graph spectral domain attack, aiming to perturb graph transform coefficients in the spectral domain that corresponds to varying certain geometric structure. Specifically, leveraging on graph signal processing, we first adaptively transform the coordinates of points onto the spectral domain via graph Fourier transform (GFT) for compact representation. Then, we analyze the influence of different spectral bands on the geometric structure, based on which we propose to perturb the GFT coefficients via a learnable graph spectral filter. Considering the low-frequency components mainly contribute to the rough shape of the 3D object, we further introduce a low-frequency constraint to limit perturbations within imperceptible high-frequency components. Finally, the adversarial point cloud is generated by transforming the perturbed spectral representation back to the data domain via the inverse GFT. Experimental results demonstrate the effectiveness of the proposed attack in terms of both the imperceptibility and attack success rates.


title: Impact of tensor force on quantum shell effects in quasifission reactions

abstract: Quantum shell effects drive many aspects of many-body quantal systems and their interactions. Among these are the quasifission reactions that impede the formation of a compound nucleus in superheavy element (SHE) searches. Fragment production in quasifission is influenced by shell effects as a nontrivial manifestation of microscopic dynamics hindering the full equilibration of the composite system to form the compound nucleus. In this Letter, we use the microscopic time-dependent Hartree-Fock (TDHF) theory to study 48Ca+249Bk collisions to investigate the influence of the tensor component of the effective nucleon-nucleon interaction. The results show that the inclusion of the tensor force causes the spherical shell effect to become more prominent, particularly for the neutron number yield whose peak is exactly at magic number N = 126. This suggests that the tensor force plays a compelling role in the evolution of dynamical shell effects in nuclear reactions, influencing the competition between spherical and deformed shell gaps.


title: Trimaximal Mixing and Extended Magic Symmetry in a Model of Neutrino Mass Matrix

abstract: The trimaximal mixing scheme (TM$_2$) results in \textit{``magic"} neutrino mass matrix ($M_\nu$) which is known to accommodate neutrino oscillation data. In this paper, we propose a phenomenological ansatz for $M_\nu$ by extending the magic symmetry that leads to further reduction in the number of free parameters, thereby, increasing the predictability of the model. The neutrino mixing parameters, effective Majorana mass $m_{ee}$ and $CP$ invariants ($J_{CP}, I_1,I_2$) are found to exhibit strong correlations for TM$_2$ mixing paradigm. One of the generic feature of the model is the requirement of non-maximal $\theta_{23}$ for possible $CP$ violation measurable in neutrino oscillation experiments. The observables $m_{ee}$ and sum of neutrino masses ($\sum m_i$) have imperative implications for yet unknown neutrino mass hierarchy. For inverted hierarchy, the lower bound on $m_{ee}>0.02$ eV, predicted by the model, is found to be within the sensitivity reach of the $0\nu\beta\beta$ decay experiments. Also, cosmological bound of $0.12$ eV on $\sum m_i$, at 95\% CL, refutes inverted hierarchy implying TM$_2$ with normal hierarchy as the only viable possibility in the model. We have, also, illustrated a scenario wherein such a construction of the neutrino mass matrix can be realized using $\Delta(54)$ symmetry in the framework of Type-I+II seesaw mechanism.


title: Gaia: Graph Neural Network with Temporal Shift aware Attention for Gross Merchandise Value Forecast in E-commerce

abstract: E-commerce has gone a long way in empowering merchants through the internet. In order to store the goods efficiently and arrange the marketing resource properly, it is important for them to make the accurate gross merchandise value (GMV) prediction. However, it's nontrivial to make accurate prediction with the deficiency of digitized data. In this article, we present a solution to better forecast GMV inside Alipay app. Thanks to graph neural networks (GNN) which has great ability to correlate different entities to enrich information, we propose Gaia, a graph neural network (GNN) model with temporal shift aware attention. Gaia leverages the relevant e-seller' sales information and learn neighbor correlation based on temporal dependencies. By testing on Alipay's real dataset and comparing with other baselines, Gaia has shown the best performance. And Gaia is deployed in the simulated online environment, which also achieves great improvement compared with baselines.


title: Graphical Gaussian models associated to a homogeneous graph with permutation symmetries

abstract: We consider multivariate centered Gaussian models for the random vector $(Z^1,\ldots, Z^p)$, whose conditional structure is described by a homogeneous graph and which is invariant under the action of a permutation subgroup. The following paper concerns with model selection within colored graphical Gaussian models, when the underlying conditional dependency graph is known. We derive an analytic expression of the normalizing constant of the Diaconis-Ylvisaker conjugate prior for the precision parameter and perform Bayesian model selection in the class of graphical Gaussian models invariant by the action of a permutation subgroup. We illustrate our results with a toy example of dimension $5$.


title: Subword Dictionary Learning and Segmentation Techniques for Automatic Speech Recognition in Tamil and Kannada

abstract: We present automatic speech recognition (ASR) systems for Tamil and Kannada based on subword modeling to effectively handle unlimited vocabulary due to the highly agglutinative nature of the languages. We explore byte pair encoding (BPE), and proposed a variant of this algorithm named extended-BPE, and Morfessor tool to segment each word as subwords. We have effectively incorporated maximum likelihood (ML) and Viterbi estimation techniques with weighted finite state transducers (WFST) framework in these algorithms to learn the subword dictionary from a large text corpus. Using the learnt subword dictionary, the words in training data transcriptions are segmented to subwords and we train deep neural network ASR systems which recognize subword sequence for any given test speech utterance. The output subword sequence is then post-processed using deterministic rules to get the final word sequence such that the actual number of words that can be recognized is much larger. For Tamil ASR, We use 152 hours of data for training and 65 hours for testing, whereas for Kannada ASR, we use 275 hours for training and 72 hours for testing. Upon experimenting with different combination of segmentation and estimation techniques, we find that the word error rate (WER) reduces drastically when compared to the baseline word-level ASR, achieving a maximum absolute WER reduction of 6.24% and 6.63% for Tamil and Kannada respectively.


title: RealTime QA: What's the Answer Right Now?

abstract: We introduce REALTIME QA, a dynamic question answering (QA) platform that announces questions and evaluates systems on a regular basis (weekly in this version). REALTIME QA inquires about the current world, and QA systems need to answer questions about novel events or information. It therefore challenges static, conventional assumptions in open-domain QA datasets and pursues instantaneous applications. We build strong baseline models upon large pretrained language models, including GPT-3 and T5. Our benchmark is an ongoing effort, and this paper presents real-time evaluation results over the past year. Our experimental results show that GPT-3 can often properly update its generation results, based on newly-retrieved documents, highlighting the importance of up-to-date information retrieval. Nonetheless, we find that GPT-3 tends to return outdated answers when retrieved documents do not provide sufficient information to find an answer. This suggests an important avenue for future research: can an open-domain QA system identify such unanswerable cases and communicate with the user or even the retrieval module to modify the retrieval results? We hope that REALTIME QA will spur progress in instantaneous applications of question answering and beyond.


title: Knowledge-driven Subword Grammar Modeling for Automatic Speech Recognition in Tamil and Kannada

abstract: In this paper, we present specially designed automatic speech recognition (ASR) systems for the highly agglutinative and inflective languages of Tamil and Kannada that can recognize unlimited vocabulary of words. We use subwords as the basic lexical units for recognition and construct subword grammar weighted finite state transducer (SG-WFST) graphs for word segmentation that captures most of the complex word formation rules of the languages. We have identified the following category of words (i) verbs, (ii) nouns, (ii) pronouns, and (iv) numbers. The prefix, infix and suffix lists of subwords are created for each of these categories and are used to design the SG-WFST graphs. We also present a heuristic segmentation algorithm that can even segment exceptional words that do not follow the rules encapsulated in the SG-WFST graph. Most of the data-driven subword dictionary creation algorithms are computation driven, and hence do not guarantee morpheme-like units and so we have used the linguistic knowledge of the languages and manually created the subword dictionaries and the graphs. Finally, we train a deep neural network acoustic model and combine it with the pronunciation lexicon of the subword dictionary and the SG-WFST graph to build the subword-ASR systems. Since the subword-ASR produces subword sequences as output for a given test speech, we post-process its output to get the final word sequence, so that the actual number of words that can be recognized is much higher. Upon experimenting the subword-ASR system with the IISc-MILE Tamil and Kannada ASR corpora, we observe an absolute word error rate reduction of 12.39% and 13.56% over the baseline word-based ASR systems for Tamil and Kannada, respectively.


title: Fast optical refocusing through multimode fiber bend using Cake-Cutting Hadamard encoding algorithm to improve robustness

abstract: Multimode fibres offer the advantages of high resolution and miniaturization over single mode fibers in the field of optical imaging. However, multimode fibre's imaging is susceptible to perturbations of MMF that can lead to secondary spatial distortions in the transmitted image. Perturbations include random disturbances in the fiber as well as environmental noise. Here, we exploit the fast focusing capability of the Cake-Cutting Hadamard coding algorithm to counteract the effects of perturbations and improve the system's robustness. Simulation shows that it can approach the theoretical enhancement at 2000 measurements. Experimental results show that the algorithm can help the system to refocus in a short time when MMFs are perturbed. This research will further contribute to using multimode fibres in medicine, communication, and detection.


title: New classes of permutation polynomials with coefficients 1 over finite fields

abstract: Permutation polynomials with coefficients 1 over finite fields attract researchers' interests due to their simple algebraic form. In this paper, we first construct four classes of fractional permutation polynomials over the cyclic subgroup of $ \mathbb{F}_{2^{2m}} $. From these permutation polynomials, three new classes of permutation polynomials with coefficients 1 over $ \mathbb{F}_{2^{2m}} $ are constructed, and three more general new classes of permutation polynomials with coefficients 1 over $ \mathbb{F}_{2^{2m}} $ are constructed using a new method we presented recently. Some known permutation polynomials are the special cases of our new permutation polynomials. Furthermore, we prove that, in all new permutation polynomials, there exists a permutation polynomial which is EA-inequivalent to known permutation polynomials for all even positive integer $ m $. This proof shows that EA-inequivalent permutation polynomials over $ \mathbb{F}_{q} $ can be constructed from EA-equivalent permutation polynomials over the cyclic subgroup of $ \mathbb{F}_{q} $. From this proof, it is obvious that, in all new permutation polynomials, there exists a permutation polynomial of which algebraic degree is the maximum algebraic degree of permutation polynomials over $ \mathbb{F}_{2^{2m}} $.


title: Systems biorthogonal to exponential systems on a finite union of intervals

abstract: We study the properties of a system biorthogonal to a complete and minimal system of exponentials in $L^2(E)$, where $E$ is a finite union of intervals, and show that in the case when $E$ is a union of two or three intervals the biorthogonal system is also complete.


title: Two-Stream UNET Networks for Semantic Segmentation in Medical Images

abstract: Recent advances of semantic image segmentation greatly benefit from deeper and larger Convolutional Neural Network (CNN) models. Compared to image segmentation in the wild, properties of both medical images themselves and of existing medical datasets hinder training deeper and larger models because of overfitting. To this end, we propose a novel two-stream UNET architecture for automatic end-to-end medical image segmentation, in which intensity value and gradient vector flow (GVF) are two inputs for each stream, respectively. We demonstrate that two-stream CNNs with more low-level features greatly benefit semantic segmentation for imperfect medical image datasets. Our proposed two-stream networks are trained and evaluated on the popular medical image segmentation benchmarks, and the results are competitive with the state of the art. The code will be released soon.


title: Selectively controlled ferromagnets by electric fields in van der Waals ferromagnetic heterojunctions

abstract: Charge transfer plays a key role at the interfaces of heterostructures, which can affect electronic structures and ultimately the physical properties of the materials. However, charge transfer is difficult to manipulate externally once the interface formed. Here, we report electrically tunable charge transfer in Fe3GeTe2/Cr2Ge2Te6/Fe3GeTe2 all-magnetic van der Waals heterostructures, which can be exploited to selectively modify the magnetic properties of the top or bottom Fe3GeTe2 electrodes. The directional charge transfer from metallic Fe3GeTe2 to semiconducting Cr2Ge2Te6 remarkably modifies magnetic anisotropy energy of Fe3GeTe2, leading to the dramatically suppressed coercivity. The electrically selective control of ferromagnets demonstrated in this study could stimulate the development of spintronic devices based on van der Waals magnets.


title: ALBench: A Framework for Evaluating Active Learning in Object Detection

abstract: Active learning is an important technology for automated machine learning systems. In contrast to Neural Architecture Search (NAS) which aims at automating neural network architecture design, active learning aims at automating training data selection. It is especially critical for training a long-tailed task, in which positive samples are sparsely distributed. Active learning alleviates the expensive data annotation issue through incrementally training models powered with efficient data selection. Instead of annotating all unlabeled samples, it iteratively selects and annotates the most valuable samples. Active learning has been popular in image classification, but has not been fully explored in object detection. Most of current approaches on object detection are evaluated with different settings, making it difficult to fairly compare their performance. To facilitate the research in this field, this paper contributes an active learning benchmark framework named as ALBench for evaluating active learning in object detection. Developed on an automatic deep model training system, this ALBench framework is easy-to-use, compatible with different active learning algorithms, and ensures the same training and testing protocols. We hope this automated benchmark system help researchers to easily reproduce literature's performance and have objective comparisons with prior arts. The code will be release through Github.


title: PointFix: Learning to Fix Domain Bias for Robust Online Stereo Adaptation

abstract: Online stereo adaptation tackles the domain shift problem, caused by different environments between synthetic (training) and real (test) datasets, to promptly adapt stereo models in dynamic real-world applications such as autonomous driving. However, previous methods often fail to counteract particular regions related to dynamic objects with more severe environmental changes. To mitigate this issue, we propose to incorporate an auxiliary point-selective network into a meta-learning framework, called PointFix, to provide a robust initialization of stereo models for online stereo adaptation. In a nutshell, our auxiliary network learns to fix local variants intensively by effectively back-propagating local information through the meta-gradient for the robust initialization of the baseline model. This network is model-agnostic, so can be used in any kind of architectures in a plug-and-play manner. We conduct extensive experiments to verify the effectiveness of our method under three adaptation settings such as short-, mid-, and long-term sequences. Experimental results show that the proper initialization of the base stereo model by the auxiliary network enables our learning paradigm to achieve state-of-the-art performance at inference.


title: Towards Clear Expectations for Uncertainty Estimation

abstract: If Uncertainty Quantification (UQ) is crucial to achieve trustworthy Machine Learning (ML), most UQ methods suffer from disparate and inconsistent evaluation protocols. We claim this inconsistency results from the unclear requirements the community expects from UQ. This opinion paper offers a new perspective by specifying those requirements through five downstream tasks where we expect uncertainty scores to have substantial predictive power. We design these downstream tasks carefully to reflect real-life usage of ML models. On an example benchmark of 7 classification datasets, we did not observe statistical superiority of state-of-the-art intrinsic UQ methods against simple baselines. We believe that our findings question the very rationale of why we quantify uncertainty and call for a standardized protocol for UQ evaluation based on metrics proven to be relevant for the ML practitioner.


title: Quantum Steering: Practical Challenges and Perspectives

abstract: Einstein-Rosen-Podolsky (EPR) steering or quantum steering describes the "spooky-action-at-a-distance" that one party is able to remotely alter the states of the other if they share a certain entangled state. Generally, it admits an operational interpretation as the task of verifying entanglement without trust in the steering party's devices, making it lying intermediate between Bell nonlocality and entanglement. Together with the asymmetrical nature, quantum steering has attracted a considerable interest from theoretical and experimental sides over past decades. In this Perspective, we present a brief overview of the EPR steering with emphasis on recent progress, discuss current challenges, opportunities and propose various future directions. We look to the future which directs research to a larger-scale level beyond massless and microscopic systems to reveal steering of higher dimensionality, and to build up steered networks composed of multiple parties.


title: Towards Soft Fairness in Restless Multi-Armed Bandits

abstract: Restless multi-armed bandits (RMAB) is a framework for allocating limited resources under uncertainty. It is an extremely useful model for monitoring beneficiaries and executing timely interventions to ensure maximum benefit in public health settings (e.g., ensuring patients take medicines in tuberculosis settings, ensuring pregnant mothers listen to automated calls about good pregnancy practices). Due to the limited resources, typically certain communities or regions are starved of interventions that can have follow-on effects. To avoid starvation in the executed interventions across individuals/regions/communities, we first provide a soft fairness constraint and then provide an approach to enforce the soft fairness constraint in RMABs. The soft fairness constraint requires that an algorithm never probabilistically favor one arm over another if the long-term cumulative reward of choosing the latter arm is higher. Our approach incorporates softmax based value iteration method in the RMAB setting to design selection algorithms that manage to satisfy the proposed fairness constraint. Our method, referred to as SoftFair, also provides theoretical performance guarantees and is asymptotically optimal. Finally, we demonstrate the utility of our approaches on simulated benchmarks and show that the soft fairness constraint can be handled without a significant sacrifice on value.


title: Inverse Airborne Optical Sectioning

abstract: We present Inverse Airborne Optical Sectioning (IAOS) an optical analogy to Inverse Synthetic Aperture Radar (ISAR). Moving targets, such as walking people, that are heavily occluded by vegetation can be made visible and tracked with a stationary optical sensor (e.g., a hovering camera drone above forest). We introduce the principles of IAOS (i.e., inverse synthetic aperture imaging), explain how the signal of occluders can be further suppressed by filtering the Radon transform of the image integral, and present how targets motion parameters can be estimated manually and automatically. Finally, we show that while tracking occluded targets in conventional aerial images is infeasible, it becomes efficiently possible in integral images that result from IAOS.


title: Traffic Sign Detection With Event Cameras and DCNN

abstract: In recent years, event cameras (DVS - Dynamic Vision Sensors) have been used in vision systems as an alternative or supplement to traditional cameras. They are characterised by high dynamic range, high temporal resolution, low latency, and reliable performance in limited lighting conditions -- parameters that are particularly important in the context of advanced driver assistance systems (ADAS) and self-driving cars. In this work, we test whether these rather novel sensors can be applied to the popular task of traffic sign detection. To this end, we analyse different representations of the event data: event frame, event frequency, and the exponentially decaying time surface, and apply video frame reconstruction using a deep neural network called FireNet. We use the deep convolutional neural network YOLOv4 as a detector. For particular representations, we obtain a detection accuracy in the range of 86.9-88.9% mAP@0.5. The use of a fusion of the considered representations allows us to obtain a detector with higher accuracy of 89.9% mAP@0.5. In comparison, the detector for the frames reconstructed with FireNet is characterised by an accuracy of 72.67% mAP@0.5. The results obtained illustrate the potential of event cameras in automotive applications, either as standalone sensors or in close cooperation with typical frame-based cameras.


title: Convex Polytopes, Dihedral Angles, Mean Curvature and Scalar Curvature

abstract: We approximate boundaries of convex polytopes by smooth hypersurfaces $Y=Y_\varepsilon$ with {\it positive mean curvatures} and, by using basic geometric relations between the scalar curvatures of Riemannin manifolds and the mean curvatures of their boundaries, establish {\it lower bound on the dihedral angles} of these polytopes.


title: Planetesimal Dynamics in the Presence of a Giant Planet II: Dependence on Planet Mass and Eccentricity

abstract: The presence of an early-formed giant planet in the protoplanetary disk has mixed influence on the growth of other planetary embryos. Gravitational perturbation from the planet can increase the relative velocities of planetesimals at the mean motion resonances to very high values and impede accretion at those locations. However, gas drag can also align the orbital pericenters of equal-size planetesimals in certain disk locations and make them dynamically quiet and "accretion-friendly" locations for planetesimals of similar sizes. Following the previous paper, where we investigated the effect of a Jupiter-like planet on an external planetesimal disk, we generalize our findings to extrasolar planetary systems by varying the planet parameters. In particular, we focus on the dependence of the planetesimal relative velocities on the mass and eccentricity of the existing planet. We found that the velocity dispersion of identical-mass particles increases monotonically with increasing planet mass. Meanwhile, the dependence of the relative velocity between different-mass planetesimals on their mass ratio becomes weaker as the planet mass increases. While the relative velocities generally increases with increasing planet eccentricity, the velocity dispersion of smaller-mass particles ($m \lesssim 10^{18}~\rm{g}$) is almost independent of planet eccentricity owing to their strong coupling to gas. We find that the erosion limits are met for a wider range of parameters (planet mass/eccentricity, planetesimal mass ratio) when the planetesimal size decreases. Our results could provide some clues for the formation of Saturn's core as well as the architecture of some exoplanetary systems with multiple cold giant planets.


title: Power Law Rheology of Folded Protein Hydrogels

abstract: Folded protein hydrogels are prime candidates as tuneable biomaterials but it is unclear to what extent their mechanical properties have mesoscopic, as opposed to molecular origins. To address this, we probe hydrogels of the muscle-derived protein $I27_5$, using a multimodal rheology approach. Across multiple protocols, the hydrogels consistently exhibit power-law viscoelasticity in the linear viscoelastic regime with an exponent $\beta = 0.03$, suggesting a dense fractal meso-structure, with predicted fractal dimension $d_f = 2.48$. In the nonlinear viscoelastic regime, the hydrogel undergoes stiffening and energy dissipation, indicating simultaneous alignment and unfolding of the folded proteins. Remarkably, this behaviour is highly reversible, as the value of $\beta$, $d_f$ and the viscoelastic moduli return to their equilibrium value, even after multiple cycles of deformation. This highlights a previously unrevealed diversity of viscoelastic properties that originate on the mesoscopic scale. These considerations are likely to be key to controlling the viscoelasticity of folded protein hydrogels.


title: Dirac fermions with plaquette interactions. III. SU(N) phase diagram with Gross-Neveu criticality and first-order phase transition

abstract: Inspired by our recent works[1, 2] of SU(2) and SU(4) Dirac fermions subjected to plaquette interactions on square lattice, here we extend the large-scale quantum Monte Carlo investigations to the phase digram of correlated Dirac fermions with SU(6) and SU(8) symmetries subjected to the plaquette interaction on the same lattice. From SU(2) to SU(8), the rich phase diagram exhibits a plethora of emerging quantum phases such as the Dirac semimetal, the antiferromagnetic Mott insulator, valence bond solid (VBS) and the Dirac spin liquid and phase transitions including the Gross-Neveu chiral transitions with emergent continuous symmetry, the deconfined quantum criticality and the first order transition between interaction-driven columnar VBS and plaquette VBS. These rich phenomena coming from the simple-looking lattice models, firmly convey the message that the interplay between the $SU(N)$ Dirac fermions -- with enhanced internal symmetries -- and extended plaquette interactions -- beyond the on-site Hubbard type -- is the new playground to synthesise novel highly entangled quantum matter both at the model level and with experimental feasibilities.

categories: cond-mat.str-el cond-mat.stat-mech physics.comp-ph quant-ph


title: Affine models with path-dependence under parameter uncertainty and their application in finance

abstract: In this work we consider one-dimensional generalized affine processes under the paradigm of Knightian uncertainty (so-called non-linear generalized affine models). This extends and generalizes previous results in Fadina et al. (2019) and L\"utkebohmert et al. (2022). In particular, we study the case when the payoff is allowed to depend on the path, like it is the case for barrier options or Asian options. To this end, we develop the path-dependent setting for the value function which we do by relying on functional It\^o calculus. We establish a dynamic programming principle which then leads to a functional non-linear Kolmogorov equation describing the evolution of the value function. While for Asian options, the valuation can be traced back to PDE methods, this is no longer possible for more complicated payoffs like barrier options. To handle such payoffs in an efficient manner, we approximate the functional derivatives with deep neural networks and show that the numerical valuation under parameter uncertainty is highly tractable. Finally, we consider the application to structural modelling of credit and counterparty risk, where both parameter uncertainty and path-dependence are crucial and the approach proposed here opens the door to efficient numerical methods in this field.


title: Redshift Evolution of the Feedback / Cooling Equilibrium in the Core of 48 SPT Galaxy Clusters: A Joint $\boldsymbol{Chandra}$-SPT-ATCA analysis

abstract: We analyze the cooling and feedback properties of 48 galaxy clusters at redshifts $0.4 < z < 1.3$ selected from the South Pole Telescope (SPT) catalogs to evolve like the progenitors of massive and well-studied systems at $z{\sim}0$. We estimate the radio power at the brightest cluster galaxy (BCG) location of each cluster from an analysis of Australia Telescope Compact Array (ATCA) data. Assuming that the scaling relation between radio power and active galactic nucleus (AGN) cavity power $P_{\mathrm{cav}}$ observed at low redshift does not evolve with redshift, we use these measurements in order to estimate the expected AGN cavity power in the core of each system. We estimate the X-ray luminosity within the cooling radius $L_{\mathrm{cool}}$ of each cluster from a joint analysis of the available $Chandra$ X-ray and SPT Sunyaev-Zel'dovich (SZ) data. This allows us to characterize the redshift evolution of the $P_{\mathrm{cav}} / L_{\mathrm{cool}}$ ratio. When combined with low-redshift results, these constraints enable investigations of the properties of the feedback/cooling cycle across 9~Gyr of cluster growth. We model the redshift evolution of this ratio measured for cool core clusters by a log-normal distribution $\mathrm{Log}$-$\mathcal{N}(\alpha + \beta z, \sigma^2)$ and constrain the slope of the mean evolution $\beta = -0.05\pm 0.47$. This analysis improves the constraints on the slope of this relation by a factor of two. We find no evidence of redshift evolution of the feedback/cooling equilibrium in these clusters which suggests that the onset of radio-mode feedback took place at an early stage of cluster formation. High values of $P_{\mathrm{cav}} / L_{\mathrm{cool}}$ are found at the BCG location of non-cool core clusters which might suggest that the timescales of the AGN feedback cycle and the cool core / non-cool core transition are different.


title: COVID-19 and social media: Beyond polarization

abstract: The COVID-19 pandemic brought upon a massive wave of disinformation, exacerbating polarization in the increasingly divided landscape of online discourse. In this context, popular social media users play a major role, as they have the ability to broadcast messages to large audiences and influence public opinion. In this paper, we make use of openly available data to study the behavior of popular users discussing the pandemic on Twitter. We tackle the issue from a network perspective, considering users as nodes and following relationships as directed edges. The resulting network structure is modeled by embedding the actors in a latent social space, where users closer to one another have a higher probability of following each other. The results suggest the existence of two distinct communities, which can be interpreted as "generally pro" and "generally against" vaccine mandates, corroborating existing evidence on the pervasiveness of echo chambers on the platform. By focusing on a number of notable users, such as politicians, activists, and news outlets, we further show that the two groups are not entirely homogeneous, and that not just the two poles are represented. To the contrary, the latent space captures an entire spectrum of beliefs between the two extremes, demonstrating that polarization, while present, is not the only driver of the network, and that more moderate, "central" users are key players in the discussion.


title: One-Trimap Video Matting

abstract: Recent studies made great progress in video matting by extending the success of trimap-based image matting to the video domain. In this paper, we push this task toward a more practical setting and propose One-Trimap Video Matting network (OTVM) that performs video matting robustly using only one user-annotated trimap. A key of OTVM is the joint modeling of trimap propagation and alpha prediction. Starting from baseline trimap propagation and alpha prediction networks, our OTVM combines the two networks with an alpha-trimap refinement module to facilitate information flow. We also present an end-to-end training strategy to take full advantage of the joint model. Our joint modeling greatly improves the temporal stability of trimap propagation compared to the previous decoupled methods. We evaluate our model on two latest video matting benchmarks, Deep Video Matting and VideoMatting108, and outperform state-of-the-art by significant margins (MSE improvements of 56.4% and 56.7%, respectively). The source code and model are available online: https://github.com/Hongje/OTVM.


title: Are Neighbors Enough? Multi-Head Neural n-gram can be Alternative to Self-attention

abstract: Impressive performance of Transformer has been attributed to self-attention, where dependencies between entire input in a sequence are considered at every position. In this work, we reform the neural $n$-gram model, which focuses on only several surrounding representations of each position, with the multi-head mechanism as in Vaswani et al.(2017). Through experiments on sequence-to-sequence tasks, we show that replacing self-attention in Transformer with multi-head neural $n$-gram can achieve comparable or better performance than Transformer. From various analyses on our proposed method, we find that multi-head neural $n$-gram is complementary to self-attention, and their combinations can further improve performance of vanilla Transformer.


title: Parameter estimation of non-ergodic Ornstein-Uhlenbeck

abstract: In this paper, we consider the statistical inference of the drift parameter $\theta$ of non-ergodic Ornstein-Uhlenbeck~(O-U) process driven by a general Gaussian process $(G_t)_{t\ge 0}$. When $H \in (0, \frac 12) \cup (\frac 12,1) $ the second order mixed partial derivative of $R (t, s) = E [G_t G_s] $ can be decomposed into two parts, one of which coincides with that of fractional Brownian motion (fBm), and the other of which is bounded by $|ts|^{H-1}$. This condition covers a large number of common Gaussian processes such as fBm, sub-fractional Brownian motion and bi-fractional Brownian motion. Under this condition, we verify that $(G_t)_{t\ge 0}$ satisfies the four assumptions in references \cite{El2016}, that is, noise has H\"{o}lder continuous path; the variance of noise is bounded by the power function; the asymptotic variance of the solution $X_T$ in the case of ergodic O-U process $X$ exists and strictly positive as $T \to \infty$; for fixed $s \in [0,T)$, the noise $G_s$ is asymptotically independent of the ergodic solution $X_T$ as $T \to \infty$, thus ensure the strong consistency and the asymptotic distribution of the estimator $\tilde{\theta}_T$ based on continuous observations of $X$. Verify that $(G_t)_{t\ge 0}$ satisfies the assumption in references \cite{Es-Sebaiy2019}, that is, the variance of the increment process $\{ \zeta_{t_i}-\zeta_{t_{i -1}}, i =1,..., n \}$ is bounded by the product of a power function and a negative exponential function, which ensure that $\hat{\theta}_n$ and $\check{\theta}_n $ are strong consistent and the sequences $\sqrt{T_n} (\hat {\theta}_n - \theta)$ and $\sqrt {T_n} (\check {\theta}_n - \theta)$ are tight based on discrete observations of $X$


title: Realizing a class of stabilizer quantum error correction codes using a single ancilla and circular connectivity

abstract: We describe a class of "neighboring-blocks" stabilizer quantum error correction codes and demonstrate that such class of codes can be implemented in a resource-efficient manner using a single ancilla and circular near-neighbor qubit connectivity. We propose an implementation for syndrome-measurement circuits for codes from the class and illustrate its workings for cases of 3-qubit repetition code, Laflamme's 5-qubit code, and Shor's 9-qubit code. For 3-qubit repetition code and Laflamme's 5-qubit code suggested scheme has the property that it uses only native two-qubit CNS gates, which potentially reduces the amount of non-correctable errors due to the shorter gate time. Elements of the scheme can be used to implement surface code with near-neighbour connectivity using single ancilla, as demonstrated in an example. We developed efficient decoding procedures for repetition codes and the Laflamme's 5-qubit code using a minimum weight-perfect matching approach to account for the specific order of measurements in our scheme. The analysis of noise levels for which the scheme could show improvements in the fidelity of a stored logical qubit in the 3-qubit repetition code and Laflamme's 5-qubit code cases is provided. We complement our results by realizing the developed scheme for a 3-qubit code using an IBM quantum processor and the Laflamme's 5-qubit code using the state-vector simulator.


title: A Single-Letter Capacity Formula for MIMO Gauss-Markov Rayleigh Fading Channels

abstract: Over the past decades, the problem of communication over finite-state Markov channels (FSMCs) has been investigated in many researches and the capacity of FSMCs has been studied in closed form under the assumption of the availability of partial/complete channel state information at the sender and/or the receiver. In our work, we focus on infinite-state Markov channels by investigating the problem of message transmission over time-varying single-user multiple-input multiple-output (MIMO) Gauss-Markov Rayleigh fading channels with average power constraint and with complete channel state information available at the receiver side (CSIR). We completely solve the problem by giving a single-letter characterization of the channel capacity in closed form and by providing a proof of it.


title: Self-Managing DRAM: A Low-Cost Framework for Enabling Autonomous and Efficient in-DRAM Operations

abstract: The memory controller is in charge of managing DRAM maintenance operations (e.g., refresh, RowHammer protection, memory scrubbing) in current DRAM chips. Implementing new maintenance operations often necessitates modifications in the DRAM interface, memory controller, and potentially other system components. Such modifications are only possible with a new DRAM standard, which takes a long time to develop, leading to slow progress in DRAM systems. In this paper, our goal is to 1) ease, and thus accelerate, the process of enabling new DRAM maintenance operations and 2) enable more efficient in-DRAM maintenance operations. Our idea is to set the memory controller free from managing DRAM maintenance. To this end, we propose Self-Managing DRAM (SMD), a new low-cost DRAM architecture that enables implementing new in-DRAM maintenance mechanisms (or modifying old ones) with no further changes in the DRAM interface, memory controller, or other system components. We use SMD to implement new in-DRAM maintenance mechanisms for three use cases: 1) periodic refresh, 2) RowHammer protection, and 3) memory scrubbing. We show that SMD enables easy adoption of efficient maintenance mechanisms that significantly improve the system performance and energy efficiency while providing higher reliability compared to conventional DDR4 DRAM. A combination of SMD-based maintenance mechanisms that perform refresh, RowHammer protection, and memory scrubbing achieve 7.6% speedup and consume 5.2% less DRAM energy on average across 20 memory-intensive four-core workloads. We make SMD source code openly and freely available at https://github.com/CMU-SAFARI/SelfManagingDRAM.


title: The strongest cool core in REXCESS: Missing X-ray cavities in RXC J2014.8-2430

abstract: We present a multiwavelength study of RXC J2014.8-2430, the most extreme cool-core cluster in the Representative $XMM-Newton$ Cluster Structure Survey (REXCESS), using $Chandra$ X-ray, Southern Astrophysical Research (SOAR) Telescope, Atacama Large Millimeter/submillimeter Array (ALMA), Very Large Array (VLA), and Giant Metrewave Radio Telescope (GMRT) observations. While feedback from an active galactic nucleus (AGN) is thought to be the dominant mechanism by which a cooling flow is suppressed, the $Chandra$ imaging observations surprisingly do not reveal the bi-lateral X-ray cavities expected in the intracluster medium (ICM) of an extreme cool core hosting a powerful radio source. We discuss the limits on the presence of any radio bubbles associated with any undetected X-ray cavities. We place upper limits on any significant X-ray AGN in the brightest cluster galaxy, and show that the X-ray peak is offset from the central radio source, which exhibits a steep low frequency radio spectrum indicative of electron ageing. The SOAR data reveal an extended, luminous emission line source. From our narrowband H$\alpha$ imaging of the BCG, the central H$\alpha$ peak is coincident with the radio observations, yet offset from the X-ray peak, consistent with sloshing found previously in this cluster. ALMA observations reveal a large reservoir of molecular gas that traces the extended H$\alpha$ emission. We conclude either that the radio source and its cavities in the X-ray gas are nearly aligned along the line of sight, or that ram pressure induced by sloshing has significantly displaced the cool molecular gas feeding it, perhaps preempting the AGN feedback cycle. We argue that the sloshing near the core is likely subsonic, as expected, given the co-location of the H$\alpha$, CO(1-0), radio continuum, and stellar emission peaks and their proximity to the intact cool core seen in X-ray.


title: High precision solutions to quantized vortices within Gross-Pitaevskii equation

abstract: The dynamics of vortices in Bose-Einstein condensates of dilute cold atoms can be well formulated by Gross-Pitaevskii equation. To better understand the properties of vortices, a systematic method to solve the nonlinear differential equation for the vortex to a very high precision is proposed. Through two-point Pad$\acute{\text{e}}$ approximants, these solutions are presented in terms of simple rational functions, which can be used in the simulation of vortex dynamics. The precision of the solutions is sensitive to the connecting parameter and the truncation orders. It can be improved significantly with a reasonable extension in the order of rational functions. The errors of the solutions and the limitation of two-point Pad$\acute{\text{e}}$ approximants are discussed. This investigation may shed light on the exact solution to the nonlinear vortex equation.


title: Learning Appearance-motion Normality for Video Anomaly Detection

abstract: Video anomaly detection is a challenging task in the computer vision community. Most single task-based methods do not consider the independence of unique spatial and temporal patterns, while two-stream structures lack the exploration of the correlations. In this paper, we propose spatial-temporal memories augmented two-stream auto-encoder framework, which learns the appearance normality and motion normality independently and explores the correlations via adversarial learning. Specifically, we first design two proxy tasks to train the two-stream structure to extract appearance and motion features in isolation. Then, the prototypical features are recorded in the corresponding spatial and temporal memory pools. Finally, the encoding-decoding network performs adversarial learning with the discriminator to explore the correlations between spatial and temporal patterns. Experimental results show that our framework outperforms the state-of-the-art methods, achieving AUCs of 98.1% and 89.8% on UCSD Ped2 and CUHK Avenue datasets.


title: Camouflaged Object Detection via Context-aware Cross-level Fusion

abstract: Camouflaged object detection (COD) aims to identify the objects that conceal themselves in natural scenes. Accurate COD suffers from a number of challenges associated with low boundary contrast and the large variation of object appearances, e.g., object size and shape. To address these challenges, we propose a novel Context-aware Cross-level Fusion Network (C2F-Net), which fuses context-aware cross-level features for accurately identifying camouflaged objects. Specifically, we compute informative attention coefficients from multi-level features with our Attention-induced Cross-level Fusion Module (ACFM), which further integrates the features under the guidance of attention coefficients. We then propose a Dual-branch Global Context Module (DGCM) to refine the fused features for informative feature representations by exploiting rich global context information. Multiple ACFMs and DGCMs are integrated in a cascaded manner for generating a coarse prediction from high-level features. The coarse prediction acts as an attention map to refine the low-level features before passing them to our Camouflage Inference Module (CIM) to generate the final prediction. We perform extensive experiments on three widely used benchmark datasets and compare C2F-Net with state-of-the-art (SOTA) models. The results show that C2F-Net is an effective COD model and outperforms SOTA models remarkably. Further, an evaluation on polyp segmentation datasets demonstrates the promising potentials of our C2F-Net in COD downstream applications. Our code is publicly available at: https://github.com/Ben57882/C2FNet-TSCVT.


title: Algebraic surfaces with canonical map of degree 13 15 17 18 21 22

abstract: In this note, we construct some minimal smooth surfaces of general type with canonical map of degree $ 13, 15, 17, 18, 21, 22 $. These surfaces are constructed as $ \mathbb{Z}_{3}^2$-covers of a blow-up of $ \mathbb{P}^1 \times \mathbb{P}^1 $.


title: Deep Clustering with Features from Self-Supervised Pretraining

abstract: A deep clustering model conceptually consists of a feature extractor that maps data points to a latent space, and a clustering head that groups data points into clusters in the latent space. Although the two components used to be trained jointly in an end-to-end fashion, recent works have proved it beneficial to train them separately in two stages. In the first stage, the feature extractor is trained via self-supervised learning, which enables the preservation of the cluster structures among the data points. To preserve the cluster structures even better, we propose to replace the first stage with another model that is pretrained on a much larger dataset via self-supervised learning. The method is simple and might suffer from domain shift. Nonetheless, we have empirically shown that it can achieve superior clustering performance. When a vision transformer (ViT) architecture is used for feature extraction, our method has achieved clustering accuracy 94.0%, 55.6% and 97.9% on CIFAR-10, CIFAR-100 and STL-10 respectively. The corresponding previous state-of-the-art results are 84.3%, 47.7% and 80.8%. Our code will be available online with the publication of the paper.


title: On the computation of modular forms on noncongruence subgroups

abstract: We present two approaches that can be used to compute modular forms on noncongruence subgroups. The first approach uses Hejhal's method for which we improve the arbitrary precision solving techniques so that the algorithm becomes about up to two orders of magnitude faster in practical computations. This allows us to obtain high precision numerical estimates of the Fourier coefficients from which the algebraic expressions can be identified using the LLL algorithm. The second approach is restricted to genus zero subgroups and uses efficient methods to compute the Belyi map from which the modular forms can be constructed.


title: The study of the alpha formation probability in 10Be and 12Be within the microscopic cluster model

abstract: The alpha clustering in the 10Be and 12Be has been studied within the framework of the real-time evolution method (REM). By using the effective interaction tuned to reproduce the charge radii and the threshold energies, we have evaluated the alpha reduced width amplitude (RWA) and spectroscopic factor (S-factor) for the ground and excited states. With several improvements made in this work, comparing with our previous calculations, larger rate of clustering results are obtained for the 10Be and 12Be with correct asymptotic at large distance.


title: Optimizing transformations for contrastive learning in a differentiable framework

abstract: Current contrastive learning methods use random transformations sampled from a large list of transformations, with fixed hyperparameters, to learn invariance from an unannotated database. Following previous works that introduce a small amount of supervision, we propose a framework to find optimal transformations for contrastive learning using a differentiable transformation network. Our method increases performances at low annotated data regime both in supervision accuracy and in convergence speed. In contrast to previous work, no generative model is needed for transformation optimization. Transformed images keep relevant information to solve the supervised task, here classification. Experiments were performed on 34000 2D slices of brain Magnetic Resonance Images and 11200 chest X-ray images. On both datasets, with 10% of labeled data, our model achieves better performances than a fully supervised model with 100% labels.


title: Distributed YSOs in the Perseus Molecular Cloud from the Gaia and LAMOST Surveys

abstract: Identifying the young optically visible population in a star-forming region is essential for fully understanding the star formation event. In this paper, We identify 211 candidate members of the Perseus molecular cloud based on Gaia astronomy. We use LAMOST spectra to confirm that 51 of these candidates are new members, bringing the total census of known members to 856. The newly confirmed members are less extincted than previously known members. Two new stellar aggregates are identified in our updated census. With the updated member list, we obtain a statistically significant distance gradient of $\rm 4.84\;pc\;deg^{-1}$ from west to east. Distances and extinction corrected color-magnitude diagrams indicate that NGC 1333 is significantly younger than IC 348 and the remaining cloud regions. The disk fraction in NGC 1333 is higher than elsewhere, consistent with its youngest age. The star formation scenario in the Perseus molecular cloud is investigated and the bulk motion of the distributed population is consistent with the cloud being swept away by the Per-Tau Shell.


title: Resonant jumps induced by stationary tidal perturbation: a two-for-one deal

abstract: Extreme-mass-ratio inspirals (EMRIs) are promising target sources for space-based interferometers such as LISA, Taiji, and Tianqin. Depending on the astrophysical environment, such as close perturbers or an accretion disk, EMRI orbital evolution may deviate from the predictions of general relativity in vacuum. In particular, we focus on the resonance jumps, i.e., the changes of the conserved quantities induced by a stationary perturbation to the background Kerr geometry. Using Hamiltonian formulation, we provide a closed relation between the jump in Carter constant and that in the axial component of angular momentum. It is also shown that the obtained relation is consistent with the fitting formulae computed for the tidal resonance in previous works.


title: MagGlove: A Haptic Glove with Movable Magnetic Force for Manipulation Learning

abstract: Recently, haptic gloves have been extensively explored for various practical applications, such as manipulation learning. Previous glove devices have different force-driven systems, such as shape memory alloys, servo motors and pneumatic actuators; however, these proposed devices may have difficulty in fast finger movement, easy reproduction, and safety issues. In this study, we propose MagGlove, a novel haptic glove with a movable magnet mechanism that has a linear motor, to solve these issues. The proposed MagGlove device is a compact system on the back of the wearer's hand with high responsiveness, ease of use, and good safety. The proposed device is adaptive with the modification of the magnitude of the current flowing through the coil. Based on our evaluation study, it is verified that the proposed device can achieve finger motion in the given tasks. Therefore, MagGlove can provide flexible support tailored to the wearers' learning levels in manipulation learning tasks.


title: Standard Model predictions for $B\to K\ell^+\ell^-$, $B\to K\ell_1^- \ell_2^+$ and $B\to K\nu\bar{\nu}$ using form factors from $N_f=2+1+1$ lattice QCD

abstract: We use HPQCD's recent lattice QCD determination of $B \to K$ scalar, vector and tensor form factors to determine Standard Model differential branching fractions for $B \to K \ell^+\ell^-$, $B\to K \ell_1^+\ell_2^-$ and $B \to K\nu \overline{\nu}$. These form factors are calculated across the full $q^2$ range of the decay and have smaller uncertainties than previous work, particularly at low $q^2$. For $B \to K \ell^+ \ell^-$ we find the Standard Model branching fraction in the $q^2$ region below the squared $J/\psi$ mass to exceed the LHCb results, with tensions as high as $4.2\sigma$ for $B^+\to K^+\mu^+\mu^-$. For the high $q^2$ region we see $2.7\sigma$ tensions. The tensions are much reduced by applying shifts to Wilson coefficients $C_9$ and $C_{10}$ in the effective weak Hamiltonian, moving them away from their Standard Model values consistent with those indicated by other $B$ phenomenology. We also update results for lepton-flavour ratios $R^{\mu}_e$ and $R^{\tau}_{\mu}$ and the `flat term', $F_H^{\ell}$ in the differential branching fraction for $\ell\in\{e,\mu,\tau\}$. Our results for the form-factor-dependent contributions needed for searches for lepton-flavour-violating decays $B\to K\ell^-_1\ell^+_2$ achieve uncertainties of 7%. We also compute the branching fraction $\mathcal{B}(B\to K\nu\bar{\nu})$ with an uncertainty below 10%, for comparison with future experimental results.


title: Charged Higgs induced 5 and 6 lepton signatures from heavy neutrinos at the LHC

abstract: We propose an anomaly free gauged U$(1)$ extension of the SM where three right handed heavy neutrinos, being charged under the general U$(1)$ gauge group, are introduced to explain the origin of the tiny neutrino mass through the seesaw mechanism after the general U$(1)$ symmetry is broken. Due to the breaking of the general U$(1)$ symmetry a neutral beyond the standard model gauge boson $Z^\prime$ acquires mass. There are two Higgs doublets in this model where one interacts with the SM fermions and the other one interacts with the right handed heavy neutrinos and charged leptons. The charged multiplet of the second Higgs can completely decay into the heavy neutrinos and charged lepton in the neutrinophilic limit of the model parameters. The charged Higgs pair production can be influenced due to presence of the $Z^\prime$ boson at the High Luminosity LHC (HL-LHC) in addition to the neutral SM gauge bosons. The pair produced charged Higgs bosons decay into SM charged leptons and heavy neutrinos. Following the leading decay modes of the heavy neutrinos into charged leptons and $W$ boson we study the 5 and 6 lepton final states after the leptonic and hadronic decay of the $W$ bosons considering solely muons and electrons in the final state. Combining the electron and muon final states we estimate the significance of the 5 and 6 charged lepton processes in the $m_{H^\pm}-m_N$ plane for different benchmark points of $m_{Z^\prime}$. It is found that the 5 (6) charged lepton processes could be probed at the High Luminosity LHC (HL-LHC) with at least 5 (3) $\sigma$ significance and there are parameter regions where the significance could be larger.


title: An Asymmetric SIMP Dark Matter Model

abstract: In this paper, we construct the first asymmetric strongly interacting massive particles (SIMP) dark matter (DM) model, where a new vector-like fermion and a new complex scalar both having nonzero chemical potentials can be asymmetric DM particles. After the spontaneous breaking of a U(1)$^{}_\textsf{D}$ dark gauge symmetry, these two particles can have accidental $\mathbb{Z}^{}_4$ charges making them stable. By adding one more complex scalar as a mediator between the SIMP DM, the relic density of DM is determined by $3 \to 2$ and two-loop induced $2 \to 2$ annihilations in this model. On the other hand, the SIMP DM can maintain kinetic equilibrium with the thermal bath until the DM freeze-out temperature via the new gauge interaction. Interestingly, this model can have a bouncing effect on DM, whereby the DM number density rises after the chemical freeze-out of DM. With this effect, the prediction of the DM self-interacting cross section in this model can be consistent with astrophysical observations, and the ratio of the DM energy density to the baryonic matter energy density can be explained by primordial asymmetries. We also predict the DM-electron elastic scattering cross section that can be used to test this model in future projected experiments.


title: Efficient Video Deblurring Guided by Motion Magnitude

abstract: Video deblurring is a highly under-constrained problem due to the spatially and temporally varying blur. An intuitive approach for video deblurring includes two steps: a) detecting the blurry region in the current frame; b) utilizing the information from clear regions in adjacent frames for current frame deblurring. To realize this process, our idea is to detect the pixel-wise blur level of each frame and combine it with video deblurring. To this end, we propose a novel framework that utilizes the motion magnitude prior (MMP) as guidance for efficient deep video deblurring. Specifically, as the pixel movement along its trajectory during the exposure time is positively correlated to the level of motion blur, we first use the average magnitude of optical flow from the high-frequency sharp frames to generate the synthetic blurry frames and their corresponding pixel-wise motion magnitude maps. We then build a dataset including the blurry frame and MMP pairs. The MMP is then learned by a compact CNN by regression. The MMP consists of both spatial and temporal blur level information, which can be further integrated into an efficient recurrent neural network (RNN) for video deblurring. We conduct intensive experiments to validate the effectiveness of the proposed methods on the public datasets.


title: Inferring origin-destination distribution of agent transfer in a complex network using deep gated recurrent units

abstract: Predicting the origin-destination (OD) probability distribution of agent transfer is an important problem for managing complex systems. However, prediction accuracy of associated statistical estimators suffer from underdetermination. While specific techniques have been proposed to overcome this deficiency, there still lacks a general approach. Here, we propose a deep neural network framework with gated recurrent units (DNNGRU) to address this gap. Our DNNGRU is \emph{network-free}, as it is trained by supervised learning with time-series data on the volume of agents passing through edges. We use it to investigate how network topologies affect OD prediction accuracy, where performance enhancement is observed to depend on the degree of overlap between paths taken by different ODs. By comparing against methods that give exact results, we demonstrate the near-optimal performance of our DNNGRU, which we found to consistently outperform existing methods and alternative neural network architectures, under diverse data generation scenarios.


title: Spin-Neutral Tunneling Anomalous Hall Effect

abstract: Anomalous Hall effect (AHE) is a fundamental spin-dependent transport property that is widely used in spintronics. It is generally expected that currents carrying net spin polarization are required to drive the AHE. Here we demonstrate that, in contrast to this common expectation, a spin-neutral tunneling AHE (TAHE), i.e. a TAHE driven by spin-neutral currents, can be realized in an antiferromagnetic (AFM) tunnel junction where an AFM electrode with a non-spin-degenerate Fermi surface and a normal metal electrode are separated by a non-magnetic barrier with strong spin-orbit coupling (SOC). The symmetry mismatch between the AFM electrode and the SOC barrier results in an asymmetric spin-dependent momentum filtering of the spin-neutral longitudinal current generating the transverse Hall current in each electrode. We predict a sizable spin-neutral TAHE in an AFM tunnel junction with a RuO$_{2}$-type AFM electrode and a SnTe-type SOC barrier and show that the Hall currents are reversible by the N\'eel vector switching. With the Hall angle being comparable to that in conventional AHE bulk materials, the predicted spin-neutral TAHE can be used for the N\'eel vector detection in antiferromagnetic spintronics.


title: Algebraic independence and difference equations over elliptic function fields

abstract: For a lattice \Lambda in the complex plane, let K_{\Lambda} be the field of \Lambda-elliptic functions. For two relatively prime integers p (respectively q) greater than 1, consider the endomorphisms \psi (resp. \phi) of K_{\Lambda} given by multiplication by p (resp. q) on the elliptic curve \mathbb{C}/\Lambda. We prove that if f (resp. g) are complex Laurent power series that satisfy linear difference equations over K_{\Lambda} with respect to \phi (resp. \psi) then there is a dichotomy. Either, for some sublattice \Lambda' of \Lambda, one of f or g belongs to the ring K_{\Lambda'}[z,z^{-1},\zeta(z,\Lambda')], where \zeta(z,\Lambda') is the Weierstrass zeta function, or f and g are algebraically independent over K_{\Lambda}. This is an elliptic analogue of a recent theorem of Adamczewski, Dreyfus, Hardouin and Wibmer (over the field of rational functions).


title: Identifying Hard Noise in Long-Tailed Sample Distribution

abstract: Conventional de-noising methods rely on the assumption that all samples are independent and identically distributed, so the resultant classifier, though disturbed by noise, can still easily identify the noises as the outliers of training distribution. However, the assumption is unrealistic in large-scale data that is inevitably long-tailed. Such imbalanced training data makes a classifier less discriminative for the tail classes, whose previously "easy" noises are now turned into "hard" ones -- they are almost as outliers as the clean tail samples. We introduce this new challenge as Noisy Long-Tailed Classification (NLT). Not surprisingly, we find that most de-noising methods fail to identify the hard noises, resulting in significant performance drop on the three proposed NLT benchmarks: ImageNet-NLT, Animal10-NLT, and Food101-NLT. To this end, we design an iterative noisy learning framework called Hard-to-Easy (H2E). Our bootstrapping philosophy is to first learn a classifier as noise identifier invariant to the class and context distributional changes, reducing "hard" noises to "easy" ones, whose removal further improves the invariance. Experimental results show that our H2E outperforms state-of-the-art de-noising methods and their ablations on long-tailed settings while maintaining a stable performance on the conventional balanced settings. Datasets and codes are available at https://github.com/yxymessi/H2E-Framework


title: Closed categories

abstract: We are checking the closed categories beginning with the category of sets and ending with the category of categories. The novelty is a generalizing the notion of adjoint functors to the joint pair of functors in the category of directed graphs. We have described for what condition we get a bijective name mapping for graphs transports. Graphs aren't instances of categories, however we believe that new notion of functors joint pair will become important also for the categorical studies. As an example of future applications we introduce the notion of relator to some tensor product.


title: Bridging Traditional and Machine Learning-based Algorithms for Solving PDEs: The Random Feature Method

abstract: One of the oldest and most studied subject in scientific computing is algorithms for solving partial differential equations (PDEs). A long list of numerical methods have been proposed and successfully used for various applications. In recent years, deep learning methods have shown their superiority for high-dimensional PDEs where traditional methods fail. However, for low dimensional problems, it remains unclear whether these methods have a real advantage over traditional algorithms as a direct solver. In this work, we propose the random feature method (RFM) for solving PDEs, a natural bridge between traditional and machine learning-based algorithms. RFM is based on a combination of well-known ideas: 1. representation of the approximate solution using random feature functions; 2. collocation method to take care of the PDE; 3. the penalty method to treat the boundary conditions, which allows us to treat the boundary condition and the PDE in the same footing. We find it crucial to add several additional components including multi-scale representation and rescaling the weights in the loss function. We demonstrate that the method exhibits spectral accuracy and can compete with traditional solvers in terms of both accuracy and efficiency. In addition, we find that RFM is particularly suited for complex problems with complex geometry, where both traditional and machine learning-based algorithms encounter difficulties.


title: Look Closer to Your Enemy: Learning to Attack via Teacher-Student Mimicking

abstract: Deep neural networks have significantly advanced person re-identification (ReID) applications in the realm of the industrial internet, yet they remain vulnerable. Thus, it is crucial to study the robustness of ReID systems, as there are risks of adversaries using these vulnerabilities to compromise industrial surveillance systems. Current adversarial methods focus on generating attack samples using misclassification feedback from victim models (VMs), neglecting VM's cognitive processes. We seek to address this by producing authentic ReID attack instances through VM cognition decryption. This approach boasts advantages like better transferability to open-set ReID tests, easier VM misdirection, and enhanced creation of realistic and undetectable assault images. However, the task of deciphering the cognitive mechanism in VM is widely considered to be a formidable challenge. In this paper, we propose a novel inconspicuous and controllable ReID attack baseline, LCYE (Look Closer to Your Enemy), to generate adversarial query images. Specifically, LCYE first distills VM's knowledge via teacher-student memory mimicking the proxy task. This knowledge prior serves as an unambiguous cryptographic token, encapsulating elements deemed indispensable and plausible by the VM, with the intent of facilitating precise adversarial misdirection. Further, benefiting from the multiple opposing task framework of LCYE, we investigate the interpretability and generalization of ReID models from the view of the adversarial attack, including cross-domain adaption, cross-model consensus, and online learning process. Extensive experiments on four ReID benchmarks show that our method outperforms other state-of-the-art attackers with a large margin in white-box, black-box, and target attacks. The source code can be found at https://github.com/MingjieWang0606/LCYE-attack_reid.


title: Exploration and Application of AI in 6G Field

abstract: The recent upsurge of diversified mobile applications, especially those supported by AI, is spurring heated discussions on the future evolution of wireless communications. While 5G is being deployed around the world, efforts from industry and academia have started to look beyond 5G and conceptualize 6G. We envision 6G to experience an unprecedented transformation that will make it completely different from the previous generations of wireless systems. In particular, 6G will go beyond mobile Internet and will be required to support AI services. Meanwhile, AI will play a critical role in designing and optimizing 6G architectures, protocols and operations. In this article, we discuss the features of 6G, and the difficulties of carrying out 6G, and AI-enabled methods for 6G network design and optimization.


title: Colorful Optical Vortices with White Light Illumination

abstract: The orbital angular momentum (OAM) of light holds great promise for applications in optical communication, super-resolution imaging, and high-dimensional quantum computing. However, the spatio-temporal coherence of the light source has been essential for generating OAM beams, as incoherent ambient light would result in polychromatic and obscured OAM beams in the visible spectrum. Here, we extend the applications of OAM to ambient lighting conditions. By miniaturizing spiral phase plates and integrating them with structural color filters, we achieve spatio-temporal coherence using only an incoherent white light source. These optical elements act as building blocks that encode both color and OAM information in the form of colorful optical vortices. Thus, pairs of transparent substrates that contain matching positions of these vortices constitute a reciprocal optical lock and key system. Due to the multiple helical eigenstates of OAM, the pairwise coupling can be further extended to form a one-to-many matching and validation scheme. Generating and decoding colorful optical vortices with broadband white light could find potential applications in anti-counterfeiting, optical metrology, high-capacity optical encryption, and on-chip 3D photonic devices.