title: When Cyber Aggression Prediction Meets BERT on Social Media

abstract: Increasingly, cyber aggression becomes the prevalent phenomenon that erodes the social media environment. However, due to subjective and expense, the traditional self-reporting questionnaire is hard to be employed in the current cyber area. In this study, we put forward the prediction model for cyber aggression based on the cutting-edge deep learning algorithm. Building on 320 active Weibo users' social media activities, we construct basic, dynamic, and content features. We elaborate cyber aggression on three dimensions: social exclusion, malicious humour, and guilt induction. We then build the prediction model combined with pretrained BERT model. The empirical evidence shows outperformance and supports a stronger prediction with the BERT model than traditional machine learning models without extra pretrained information. This study offers a solid theoretical model for cyber aggression prediction. Furthermore, this study contributes to cyber aggression behaviors' probing and social media platforms' organization.


title: Cluster-shell competition and effect of adding hyperons

abstract: The fundamental question is how the hyperon plays a role in the nuclear structure. It is of particular importance, especially in the light mass region, to verify the structure change when $\Lambda$ particle(s) is added to normal nuclei. The ground state of $^{8}$Be has been know to have a well-developed $\alpha$--$\alpha$ cluster structure, whereasn$^{12}$C has a mixed structure of three $\alpha$ clusters and $jj$-coupling shell model, where $\alpha$ clusters are partially broken. Adding $\Lambda$ particle(s) could induce the structure change. We compare the Be and C cases. Using the antisymmetrized quasi-cluster model (AQCM), the $\alpha$-cluster states and $jj$-coupling shell-model states of $^8$Be and $^{12}$C are prepared on the same footing, and we add $\Lambda$ particles. The cluster-shell competition in the ground state can be well described with this model. Using AQCM, we calculate $^8$Be, $^{9}_{\Lambda}$Be, $^{10}_{\Lambda\Lambda}$Be, $^{12}$C, $^{13}_{\Lambda}$C, and $^{14}_{\Lambda\Lambda}$C. By adding one or two $\Lambda$ particle(s), the ground state of $^{12}$C approaches the $jj$-coupling shell model side. On the other hand, in the Be case, although the $\Lambda$ particle(s) shrinks the $\alpha$--$\alpha$ distance, the breaking effect of the cluster structure is rather limited. The spin-orbit interaction is the driving force of breaking the $\alpha$ clusters, and whether the glue-like effect of $\Lambda$ particle(s) attracts the cluster inside the range of this interaction is crucial. In $^{14}_{\Lambda\Lambda}$C, the breaking of $\alpha$ clusters in $^{12}$C is much enhanced by the addition of the $\Lambda$ particles than the case of free $^{12}$C. We also found that breaking $\alpha$ clusters in the ground state of $^{14}_{\Lambda\Lambda}$C affects the excited state with the pure cluster structure.


title: Learning Feature Recovery Transformer for Occluded Person Re-identification

abstract: One major issue that challenges person re-identification (Re-ID) is the ubiquitous occlusion over the captured persons. There are two main challenges for the occluded person Re-ID problem, i.e., the interference of noise during feature matching and the loss of pedestrian information brought by the occlusions. In this paper, we propose a new approach called Feature Recovery Transformer (FRT) to address the two challenges simultaneously, which mainly consists of visibility graph matching and feature recovery transformer. To reduce the interference of the noise during feature matching, we mainly focus on visible regions that appear in both images and develop a visibility graph to calculate the similarity. In terms of the second challenge, based on the developed graph similarity, for each query image, we propose a recovery transformer that exploits the feature sets of its $k$-nearest neighbors in the gallery to recover the complete features. Extensive experiments across different person Re-ID datasets, including occluded, partial and holistic datasets, demonstrate the effectiveness of FRT. Specifically, FRT significantly outperforms state-of-the-art results by at least 6.2\% Rank-1 accuracy and 7.2\% mAP scores on the challenging Occluded-Duke dataset. The code is available at https://github.com/xbq1994/Feature-Recovery-Transformer.


title: Tessellations

abstract: This work presents the tessellations and polytopes from the perspective of both n-dimensional geometry and abstract symmetry groups. It starts with a brief introduction to the terminology and a short motivation. In the first part, it engages in the construction of all regular tessellations and polytopes of n dimensions and extends this to the study of their quasi-regular and uniform generalizations. In the second part, the symmetries of polytopes and tessellations are considered and the Coxeter groups and their associated root systems are introduced and classified. In the last part, the algorithms developed for this work are described and their results discussed.


title: Phase Asymmetry of Andreev Spectra From Cooper-Pair Momentum

abstract: In analogy to conventional semiconductor diodes, the Josephson diode exhibits superconducting properties that are asymmetric in applied bias. The effect has been investigated in number of systems recently, and requires a combination of broken time-reversal and inversion symmetries. We demonstrate a dual of the usual Josephson diode effect, a nonreciprocal response of Andreev bound states to a superconducting phase difference across the normal region of a superconductor-normal-superconductor Josephson junction, fabricated using an epitaxial InAs/Al heterostructure. Phase asymmetry of the subgap Andreev spectrum is absent in the absence of in-plane magnetic field and reaches a maximum at 0.15 T applied in the plane of the junction transverse to the current direction. We interpret the phase diode effect in this system as resulting from finite-momentum Cooper pairing due to orbital coupling to the in-plane magnetic field, without invoking Zeeman or spin-orbit coupling.


title: InsPro: Propagating Instance Query and Proposal for Online Video Instance Segmentation

abstract: Video instance segmentation (VIS) aims at segmenting and tracking objects in videos. Prior methods typically generate frame-level or clip-level object instances first and then associate them by either additional tracking heads or complex instance matching algorithms. This explicit instance association approach increases system complexity and fails to fully exploit temporal cues in videos. In this paper, we design a simple, fast and yet effective query-based framework for online VIS. Relying on an instance query and proposal propagation mechanism with several specially developed components, this framework can perform accurate instance association implicitly. Specifically, we generate frame-level object instances based on a set of instance query-proposal pairs propagated from previous frames. This instance query-proposal pair is learned to bind with one specific object across frames through conscientiously developed strategies. When using such a pair to predict an object instance on the current frame, not only the generated instance is automatically associated with its precursors on previous frames, but the model gets a good prior for predicting the same object. In this way, we naturally achieve implicit instance association in parallel with segmentation and elegantly take advantage of temporal clues in videos. To show the effectiveness of our method InsPro, we evaluate it on two popular VIS benchmarks, i.e., YouTube-VIS 2019 and YouTube-VIS 2021. Without bells-and-whistles, our InsPro with ResNet-50 backbone achieves 43.2 AP and 37.6 AP on these two benchmarks respectively, outperforming all other online VIS methods.


title: Local electronic structure of dilute hydrogen in $\beta$-Ga$_2$O$_3$ probed by muons

abstract: The local electronic structure of muons (Mu) as dilute pseudo-hydrogen in single-crystalline $\beta$-Ga$_2$O$_3$ has been studied by the muon spin rotation/relaxation ($\mu$SR). High-precision measurements over a long time range of $\sim$25 $\mu$s have clearly identified two distinct Mu states: a quasi-static Mu (Mu$_1$) and fast-moving Mu (Mu$_2$). By comparing this result with predictions from the recently established ambipolarity model, these two states are respectively attributed to the relaxed-excited states associated with the donor ($E^{+/0}$) and acceptor ($E^{-/0}$) levels predicted by density functional theory (DFT) calculations for the interstitial H. Furthermore, the local electronic structure of Mu$_1$ is found to be an OMu-bonded state with three-coordinated oxygen. The structure is almost identical with the thermal equilibrium state of H, and it is found to function as an electron donor. The other Mu$_2$ is considered to be in the hydride state (Mu$^-$) from the ambipolarity model, suggesting that it is in fast diffusion motion through the short-lived neutral state due to the charge exchange reaction with conduction electrons (Mu$^0+e^-\rightleftarrows$Mu$^-$).


title: Local Fluctuations in Cavity Control of Ferroelectricity

abstract: Control of quantum matter through resonant electromagnetic cavities is a promising route towards establishing control over material phases and functionalities. Quantum paraelectric insulators -- materials which are nearly ferroelectric -- are particularly promising candidate systems for this purpose since they have strongly fluctuating collective modes which directly couple to the electric field. In this work we explore this possibility in a system comprised of a quantum paraelectric sandwiched between two high-quality metal mirrors, realizing a Fabry-Perot type cavity. By developing a full multimode, continuum description we are able to study the effect of the cavity in a spatially resolved way for a variety of system sizes and temperatures. Surprisingly, we find that once a continuum of transverse modes are included the cavity ends up suppressing ferroelectric correlations. This effect arises from the screening out of transverse photons at the cavity boundaries and as a result is confined to the surface of the paraelectric sample. We also explore the temperature dependence of this effect and find it vanishes at high temperatures, indicating it is a purely quantum mechanical effect. We connect our result to calculations of Casimir and Van der Waals forces, which we argue are closely related to the dipolar fluctuations in the quantum paraelectric. Our results are based on a general formalism and are expected to be widely applicable, paving the way towards studies of the quantum electrodynamics of heterostructures featuring multiple materials and phases.


title: Enhancement attacks in biomedical machine learning

abstract: The prevalence of machine learning in biomedical research is rapidly growing, yet the trustworthiness of such research is often overlooked. While some previous works have investigated the ability of adversarial attacks to degrade model performance in medical imaging, the ability to falsely improve performance via recently-developed "enhancement attacks" may be a greater threat to biomedical machine learning. In the spirit of developing attacks to better understand trustworthiness, we developed two techniques to drastically enhance prediction performance of classifiers with minimal changes to features: 1) general enhancement of prediction performance, and 2) enhancement of a particular method over another. Our enhancement framework falsely improved classifiers' accuracy from 50% to almost 100% while maintaining high feature similarities between original and enhanced data (Pearson's r's>0.99). Similarly, the method-specific enhancement framework was effective in falsely improving the performance of one method over another. For example, a simple neural network outperformed logistic regression by 17% on our enhanced dataset, although no performance differences were present in the original dataset. Crucially, the original and enhanced data were still similar (r=0.99). Our results demonstrate the feasibility of minor data manipulations to achieve any desired prediction performance, which presents an interesting ethical challenge for the future of biomedical machine learning. These findings emphasize the need for more robust data provenance tracking and other precautionary measures to ensure the integrity of biomedical machine learning research.


title: Equivariant $K$-theory of Springer Varieties

abstract: The aim of this paper is to describe the topological equivariant $K$-ring, in terms of generators and relations, of a Springer variety $\mathcal{F}_{\lambda}$ of type $A$ associated to a nilpotent operator having Jordan canonical form whose block sizes form a weakly decreasing sequence $\lambda=(\lambda_1,\ldots, \lambda_l)$. This parallels the description of the equivariant cohomology ring of $\mathcal{F}_{\lambda}$ due to Abe and Horiguchi and generalizes the description of ordinary topological $K$-ring of $\mathcal{F}_{\lambda}$ due to Sankaran and Uma \cite{su}.


title: A Novel Exploitative and Explorative GWO-SVM Algorithm for Smart Emotion Recognition

abstract: Emotion recognition or detection is broadly utilized in patient-doctor interactions for diseases such as schizophrenia and autism and the most typical techniques are speech detection and facial recognition. However, features extracted from these behavior-based emotion recognitions are not reliable since humans can disguise their emotions. Recording voices or tracking facial expressions for a long term is also not efficient. Therefore, our aim is to find a reliable and efficient emotion recognition scheme, which can be used for non-behavior-based emotion recognition in real-time. This can be solved by implementing a single-channel electrocardiogram (ECG) based emotion recognition scheme in a lightweight embedded system. However, existing schemes have relatively low accuracy. Therefore, we propose a reliable and efficient emotion recognition scheme - exploitative and explorative grey wolf optimizer based SVM (X - GWO - SVM) for ECG-based emotion recognition. Two datasets, one raw self-collected iRealcare dataset, and the widely-used benchmark WESAD dataset are used in the X - GWO - SVM algorithm for emotion recognition. This work demonstrates that the X - GWO - SVM algorithm can be used for emotion recognition and the algorithm exhibits superior performance in reliability compared to the use of other supervised machine learning methods in earlier works. It can be implemented in a lightweight embedded system, which is much more efficient than existing solutions based on deep neural networks.


title: An almost deterministic cooling by measurements

abstract: Nondeterministic measurement-based techniques are efficient in reshaping the population distribution of a quantum system but suffer from a limited success probability of holding the system in the target state. To reduce the experimental cost, we exploit the state-engineering mechanisms of both conditional and unconditional measurements and propose a two-step protocol assisted by a qubit to cool a resonator down to the ground state with a near-unit probability. In the first step, the unconditional measurements on the ancillary qubit are applied to reshape the target resonator from a thermal state to a reserved Fock state. The measurement sequence is optimized by reinforcement learning for a maximum fidelity. In the second step, the population on the reserved state can be faithfully transferred in a stepwise way to the resonator's ground state with a near-unit fidelity by the conditional measurements on the qubit. Intrinsic nondeterminacy of the projection-based conditional measurement is effectively inhibited by properly spacing the measurement sequence, which makes the Kraus operator act as a lowering operator for neighboring Fock states. Through dozens of measurements, the initial thermal average occupation of the resonator can be reduced by five orders in magnitude with a success probability over $95\%$.


title: FPGA Implementation of SIMON-128 Cryptographic Algorithm Using Artix-7

abstract: FPGA is a hardware architecture based on a matrix of programmable and configurable logic circuits thanks to which a large number of functionalities inside the device can be modified using a hardware description language. These functionalities must often be secured especially when the context is sensitive (military, banking, medical, legal, etc.). In this paper, we put forward an efficient implementation of SIMON's block cipher algorithm using Xilinx Vivado 2018.2. The proposed design is analyzed through simulation on Xilinx Artix-7. A prototype of our design is implemented using the xc7a35tcsg324-1 FPGA chip. Performance and results are discussed.


title: Modular Mix-and-Match Complementation of B\"{u}chi Automata (Technical Report)

abstract: Complementation of nondeterministic B\"uchi automata (BAs) is an important problem in automata theory with numerous applications in formal verification, such as termination analysis of programs, model checking, or in decision procedures of some logics. We build on ideas from a recent work on BA determinization by Li et al. and propose a new modular algorithm for BA complementation. Our algorithm allows to combine several BA complementation procedures together, with one procedure for a subset of the BA's strongly connected components (SCCs). In this way, one can exploit the structure of particular SCCs (such as when they are inherently weak or deterministic) and use more efficient specialized algorithms, regardless of the structure of the whole BA. We give a general framework into which partial complementation procedures can be plugged in, and its instantiation with several algorithms. The framework can, in general, produce a complement with an Emerson-Lei acceptance condition, which can often be more compact. Using the algorithm, we were able to establish an exponentially better new upper bound of $O(4n)$ for complementation of the recently introduced class of elevator automata. We implemented the algorithm in a prototype and performed a comprehensive set of experiments on a large set of benchmarks, showing that our framework complements well the state of the art and that it can serve as a basis for future efficient BA complementation and inclusion checking algorithms.


title: Prime Graph and Its Structures

abstract: We study the basic properties of a prime sum graph, which is a simple graph defined on $\mathbb N$ where two vertices are adjacent if and only if their sum is a prime number. Further, we investigate some specific structures that appear inside a prime sum graph as an induced subgraph.


title: On the Areas of Genus Zero Free Boundary Minimal Surfaces Embedded in the Unit $3$-ball

abstract: We prove that the area of each nonflat genus zero free boundary minimal surface embedded in the unit $3$-ball is less than the area of its radial projection to $\mathbb{S}^2$. The inequality is asymptotically sharp, and we prove any sequence of surfaces saturating it converges weakly to $\mathbb{S}^2$, as currents and as varifolds.


title: GIVL: Improving Geographical Inclusivity of Vision-Language Models with Pre-Training Methods

abstract: A key goal for the advancement of AI is to develop technologies that serve the needs not just of one group but of all communities regardless of their geographical region. In fact, a significant proportion of knowledge is locally shared by people from certain regions but may not apply equally in other regions because of cultural differences. If a model is unaware of regional characteristics, it may lead to performance disparity across regions and result in bias against underrepresented groups. We propose GIVL, a Geographically Inclusive Vision-and-Language Pre-trained model. There are two attributes of geo-diverse visual concepts which can help to learn geo-diverse knowledge: 1) concepts under similar categories have unique knowledge and visual characteristics, 2) concepts with similar visual features may fall in completely different categories. Motivated by the attributes, we design new pre-training objectives Image Knowledge Matching (IKM) and Image Edit Checking (IEC) to pre-train GIVL. Compared with similar-size models pre-trained with similar scale of data, GIVL achieves state-of-the-art (SOTA) and more balanced performance on geo-diverse V&L tasks.


title: Urban-Semantic Computer Vision: A Framework for Contextual Understanding of People in Urban Spaces

abstract: Increasing computational power and improving deep learning methods have made computer vision technologies pervasively common in urban environments. Their applications in policing, traffic management, and documenting public spaces are increasingly common. Despite the often-discussed biases in the algorithms' training and unequally borne benefits, almost all applications similarly reduce urban experiences to simplistic, reductive, and mechanistic measures. There is a lack of context, depth, and specificity in these practices that enables semantic knowledge or analysis within urban contexts, especially within the context of using and occupying urban space. This paper will critique existing uses of artificial intelligence and computer vision in urban practices to propose a new framework for understanding people, action, and public space. This paper revisits Geertz's use of thick descriptions in generating interpretive theories of culture and activity and uses this lens to establish a framework to evaluate the varied uses of computer vision technologies that weigh meaning. We discuss how the framework's positioning may differ (and conflict) between different users of the technology. This paper also discusses the current use and training of deep learning algorithms and how this process limits semantic learning and proposes three potential methodologies for gaining a more contextually specific, urban-semantic, description of urban space relevant to urbanists. This paper contributes to the critical conversations regarding the proliferation of artificial intelligence by challenging the current applications of these technologies in the urban environment by highlighting their failures within this context while also proposing an evolution of these algorithms that may ultimately make them sensitive and useful within this spatial and cultural milieu.


title: ATOMS: ALMA Three-millimeter Observations of Massive Star-forming regions -- XV. Steady Accretion from Global Collapse to Core Feeding in Massive Hub-filament System SDC335

abstract: We present ALMA Band-3/7 observations towards "the Heart" of a massive hub-filament system (HFS) SDC335, to investigate its fragmentation and accretion. At a resolution of $\sim0.03$ pc, 3 mm continuum emission resolves two massive dense cores MM1 and MM2, with $383(^{+234}_{-120})$ $M_\odot$ (10-24% mass of "the Heart") and $74(^{+47}_{-24})$ $M_\odot$, respectively. With a resolution down to 0.01 pc, 0.87 mm continuum emission shows MM1 further fragments into six condensations and multi-transition lines of H$_2$CS provide temperature estimation. The relation between separation and mass of condensations at a scale of 0.01 pc favors turbulent Jeans fragmentation where the turbulence seems to be scale-free rather than scale-dependent. We use the H$^{13}$CO$^+$ (1-0) emission line to resolve the complex gas motion inside "the Heart" in position-position-velocity space. We identify four major gas streams connected to large-scale filaments, inheriting the anti-clockwise spiral pattern. Along these streams, gas feeds the central massive core MM1. Assuming an inclination angle of $45(\pm15)^{\circ}$ and a H$^{13}$CO$^+$ abundance of $5(\pm3)\times10^{-11}$, the total mass infall rate is estimated to be $2.40(\pm0.78)\times10^{-3}$ $M_\odot$ yr$^{-1}$, numerically consistent with the accretion rates derived from the clump-scale spherical infall model and the core-scale outflows. The consistency suggests a continuous, near steady-state, and efficient accretion from global collapse, therefore ensuring core feeding. Our comprehensive study of SDC335 showcases the detailed gas kinematics in a prototypical massive infalling clump and calls for further systematic and statistical analyses in a large sample.


title: Nanoparticles Passive Targeting Allows Optical Imaging of Bone Diseases

abstract: Bone health related skeletal disorders are commonly diagnosed by X-ray imaging, but the radiation limits its use. Light excitation and optical imaging through the near-infrared-II window (NIR-II, 1000-1700 nm) can penetrate deep tissues without radiation risk, but the targeting of contrast agent is non-specific. Here, we report that lanthanide-doped nanocrystals can be passively transported by endothelial cells and macrophages from the blood vessels into bone marrow microenvironment. We found that this passive targeting scheme can be effective for longer than two months. We therefore developed an intravital 3D and high-resolution planar imaging instrumentation for bone disease diagnosis. We demonstrated the regular monitoring of 1 mm bone defects for over 10 days, with resolution similar to X-ray imaging result, but more flexible use in prognosis. Moreover, the passive targeting can be used to reveal the early onset inflammation at the joints as the synovitis in the early stage of rheumatoid arthritis. Furthermore, the proposed method is comparable to {\mu}CT in recognizing symptoms of osteoarthritis, including the mild hyperostosis in femur which is ~100 {\mu}m thicker than normal, and the growth of millimeter-scale osteophyte in the knee joint, which further proves the power and universality of our approach in diagnosis of bone diseases


title: A non-vanishing result on the singularity category

abstract: We prove that a virtually periodic object in an abelian category gives rise to a non-vanishing result on certain Hom groups in the singularity category. Consequently, for any artin algebra with infinite global dimension, its singularity category has no silting subcategory, and the associated differential graded Leavitt algebra has a non-vanishing cohomology in each degree. We verify the Singular Presilting Conjecture for singularly-minimal algebras and ultimately-closed algebras. We obtain a trichotomy on the Hom-finiteness of the cohomology of differential graded Leavitt algebras.


title: Fast Replica Exchange Stochastic Gradient Langevin Dynamics

abstract: Application of the replica exchange (i.e., parallel tempering) technique to Langevin Monte Carlo algorithms, especially stochastic gradient Langevin dynamics (SGLD), has scored great success in non-convex learning problems, but one potential limitation is the computational cost caused by running multiple chains. Upon observing that a large variance of the gradient estimator in SGLD essentially increases the temperature of the stationary distribution, we propose expediting tempering schemes for SGLD by directly estimating the bias caused by the stochastic gradient estimator. This simple idea enables us to simulate high-temperature chains at a negligible computational cost (compared to that of the low-temperature chain) while preserving the convergence to the target distribution. Our method is fundamentally different from the recently proposed m-reSGLD (multi-variance replica exchange SGLD) method in that the latter suffers from the low accuracy of the gradient estimator (e.g., the chain can fail to converge to the target) while our method benefits from it. Further, we derive a swapping rate that can be easily evaluated, providing another significant improvement over m-reSGLD. To theoretically demonstrate the advantage of our method, we develop convergence bounds in Wasserstein distances. Numerical examples for Gaussian mixture and inverse PDE models are also provided, which show that our method can converge quicker than the vanilla multi-variance replica exchange method.


title: On Sparse Regression LDPC Codes

abstract: Belief propagation applied to iterative decoding and sparse recovery through approximate message passing (AMP) are two research areas that have seen monumental progress in recent decades. Inspired by these advances, this article introduces sparse regression LDPC codes and their decoding. Sparse regression codes (SPARCs) are a class of error correcting codes that build on ideas from compressed sensing and can be decoded using AMP. In certain settings, SPARCs are known to achieve capacity; yet, their performance suffers at finite block lengths. Likewise, LDPC codes can be decoded efficiently using belief propagation and can also be capacity achieving. This article introduces a novel concatenated coding structure that combines an LDPC outer code with a SPARC-inspired inner code. Efficient decoding for such a code can be achieved using AMP with a denoiser that performs belief propagation on the factor graph of the outer LDPC code. The proposed framework exhibits performance improvements over SPARCs and standard LDPC codes for finite block lengths and results in a steep waterfall in error performance, a phenomenon not observed in uncoded SPARCs. Findings are supported by numerical results.


title: False Alarms Revealed in a Planet Search of TESS Light Curves

abstract: We examined the period distribution of transit-like signatures uncovered in a Box-Least Squares transit search of TESS light curves, and show significant pileups at periods related to instrumental and astrophysical noise sources. Signatures uncovered in a search of inverted light curves feature similar structures in the period distribution. Automated vetting methods will need to remove these excess detections, and light curve inversion appears to be a suitable method for simulating false alarms and designing new vetting metrics.


title: TAC+: Optimizing Error-Bounded Lossy Compression for 3D AMR Simulations

abstract: Today's scientific simulations require significant data volume reduction because of the enormous amounts of data produced and the limited I/O bandwidth and storage space. Error-bounded lossy compression has been considered one of the most effective solutions to the above problem. However, little work has been done to improve error-bounded lossy compression for Adaptive Mesh Refinement (AMR) simulation data. Unlike the previous work that only leverages 1D compression, in this work, we propose an approach (TAC) to leverage high-dimensional SZ compression for each refinement level of AMR data. To remove the data redundancy across different levels, we propose several pre-process strategies and adaptively use them based on the data features. We further optimize TAC to TAC+ by improving the lossless encoding stage of SZ compression to handle many small AMR data blocks after the pre-processing efficiently. Experiments on 10 AMR datasets from three real-world large-scale AMR simulations demonstrate that TAC+ can improve the compression ratio by up to 4.9$\times$ under the same data distortion, compared to the state-of-the-art method. In addition, we leverage the flexibility of our approach to tune the error bound for each level, which achieves much lower data distortion on two application-specific metrics.


title: What is in a Text-to-Image Prompt: The Potential of Stable Diffusion in Visual Arts Education

abstract: Text-to-Image artificial intelligence (AI) recently saw a major breakthrough with the release of Dall-E and its open-source counterpart, Stable Diffusion. These programs allow anyone to create original visual art pieces by simply providing descriptions in natural language (prompts). Using a sample of 72,980 Stable Diffusion prompts, we propose a formalization of this new medium of art creation and assess its potential for teaching the history of art, aesthetics, and technique. Our findings indicate that text-to-Image AI has the potential to revolutionize the way art is taught, offering new, cost-effective possibilities for experimentation and expression. However, it also raises important questions about the ownership of artistic works. As more and more art is created using these programs, it will be crucial to establish new legal and economic models to protect the rights of artists.


title: $k$-torsionfree modules and Frobenius extensions

abstract: Let $R/S$ be a Frobenius extension and $k$ be a positive integer. We prove that an $R$-module is $k$-torsionfree if and only if so is its underlying $S$-module. As an application, we obtain that if $S$ is a quasi $k$-Gorenstein ring then so is $R$, but the converse does not hold in general.


title: Piloting Virtual Reality Photo-Based Tours among Students of a Filipino Language Class: A Case of Emergency Remote Teaching in Japan

abstract: The State of Emergency declaration in Japan due to the COVID-19 pandemic affected many aspects of society in the country, much like the rest of the world. One sector that felt its disruptive impact was education. As educational institutions raced to implement emergency remote teaching (ERT) to continue providing the learning needs of students, some have opened to innovative interventions. This paper describes a case of ERT where Filipino vocabulary was taught to a class of Japanese students taking Philippine Studies in a Japanese university using a cognitive innovation based on virtual reality, an immer-sive technology often researched for immersion and presence. Students were divided into three groups to experience six lessons designed around virtual reality photo-based tours at different immersion levels. While the effect of immersion on satisfaction was not found to be statistically significant, presence and satisfaction were found to be correlated. Despite challenges that were encountered, benefits like enjoyment, increased engagement , and perceived learning were reported by the students. Our findings exemplify how emerging multisensory technologies can be used to enhance affective and cognitive dimensions of human experience while responding to gaps created by the spatial limitations of remote learning.


title: FireFly: A High-Throughput Hardware Accelerator for Spiking Neural Networks with Efficient DSP and Memory Optimization

abstract: Spiking neural networks (SNNs) have been widely used due to their strong biological interpretability and high energy efficiency. With the introduction of the backpropagation algorithm and surrogate gradient, the structure of spiking neural networks has become more complex, and the performance gap with artificial neural networks has gradually decreased. However, most SNN hardware implementations for field-programmable gate arrays (FPGAs) cannot meet arithmetic or memory efficiency requirements, which significantly restricts the development of SNNs. They do not delve into the arithmetic operations between the binary spikes and synaptic weights or assume unlimited on-chip RAM resources by using overly expensive devices on small tasks. To improve arithmetic efficiency, we analyze the neural dynamics of spiking neurons, generalize the SNN arithmetic operation to the multiplex-accumulate operation, and propose a high-performance implementation of such operation by utilizing the DSP48E2 hard block in Xilinx Ultrascale FPGAs. To improve memory efficiency, we design a memory system to enable efficient synaptic weights and membrane voltage memory access with reasonable on-chip RAM consumption. Combining the above two improvements, we propose an FPGA accelerator that can process spikes generated by the firing neuron on-the-fly (FireFly). FireFly is the first SNN accelerator that incorporates DSP optimization techniques into SNN synaptic operations. FireFly is implemented on several FPGA edge devices with limited resources but still guarantees a peak performance of 5.53TOP/s at 300MHz. As a lightweight accelerator, FireFly achieves the highest computational density efficiency compared with existing research using large FPGA devices.


title: Realtime Safety Control for Bipedal Robots to Avoid Multiple Obstacles via CLF-CBF Constraints

abstract: This paper presents a reactive planning system that allows a Cassie-series bipedal robot to avoid multiple non-overlapping obstacles via a single, continuously differentiable control barrier function (CBF). The overall system detects an individual obstacle via a height map derived from a LiDAR point cloud and computes an elliptical outer approximation, which is then turned into a CBF. The QP-CLF-CBF formalism developed by Ames et al. is applied to ensure that safe trajectories are generated. Liveness is ensured by an analysis of induced equilibrium points that are distinct from the goal state. Safe planning in environments with multiple obstacles is demonstrated both in simulation and experimentally on the Cassie biped.


title: Graphic Elementary Lift of Cographic Matroids

abstract: A matroid $N$ is a lift of a binary matroid $M$, if $N=Q\backslash X$ when $Q/X=M$ for some binary matroid $Q$ and $X \subseteq E(Q)$ and is called an elementary lift of $M$, if $|X|=1$. A splitting operation on a binary matroid can result in an elementary lift. An elementary lift of a cographic or a graphic matroid need not be cographic or graphic. We intend to characterize the cographic matroids whose elementary lift is a graphic matroid.


title: Virtual Reality Photo-based Tours for Teaching Filipino Vocabulary in an Online Class in Japan: Transitioning into the New Normal

abstract: When educational institutions worldwide scrambled for ways to continue their classes during lockdowns caused by the COVID-19 pandemic, the use of information and communication technology (ICT) for remote teaching has become widely considered to be a potential solution. As universities raced to implement emergency remote teaching (ERT) strategies in Japan, some have explored innovative interventions other than webinar platforms and learning management systems to bridge the gap caused by restricted mobility among teachers and learners. One such innovation is virtual reality (VR). VR has been changing the landscape of higher education because of its ability to "teleport" learners to various places by simulating real-world environments in the virtual world. Some teachers, including the authors of this paper, explored integrating VR into their activities to address issues caused by geographical limitations brought about by the heightened restrictions in 2020. Results were largely encouraging. However, rules started relaxing in the succeeding years as more people got vaccinated. Thus, some fully online classes in Japan shifted to blended learning as they moved toward fully returning to in-person classes prompting educators to modify how they implemented their VR-based interventions. This paper describes how a class of university students in Japan who were taking a Filipino language course experienced a VR-based intervention in blended mode, which was originally prototyped during the peak of the ERT era. Moreover, adjustments and comparisons regarding methodological idiosyncrasies and findings between the fully online iteration and the recently implemented blended one are reported in detail.


title: Solid phase transitions in the liquid limit

abstract: We address the fundamental difference between solid-solid and liquid-liquid phase transitions within the Ericksen's nonlinear elasticity paradigm. To highlight ideas, we consider the simplest nontrivial 2D problem and work with a prototypical two-phase Hadamard material which allows one to weaken the rigidity and explore the nature of solid-solid phase transitions in a ``near-liquid'' limit. In the language of calculus of variations we probe limits of quasiconvexity in an ``almost liquid'' solid by comparing the thresholds for cooperative (laminate based) and non-cooperative (inclusion based) nucleation. Using these two types of nucleation tests we obtain for our model material surprisingly tight two-sided bounds on the elastic binodal without directly computing the quasiconvex envelope.


title: Differentiability of the largest Lyapunov exponent for planar open billiards

abstract: In this paper, we estimate the largest Lyapunov exponent for open billiards in the plane. We show that the largest Lyapunov exponent is differentiable with respect to a billiard deformation.


title: TractGraphCNN: anatomically informed graph CNN for classification using diffusion MRI tractography

abstract: The structure and variability of the brain's connections can be investigated via prediction of non-imaging phenotypes using neural networks. However, known neuroanatomical relationships between input features are generally ignored in network design. We propose TractGraphCNN, a novel, anatomically informed graph CNN framework for machine learning tasks using diffusion MRI tractography. An EdgeConv module aggregates features from anatomically similar white matter connections indicated by graph edges, and an attention module enables interpretation of predictive white matter tracts. Results in a sex prediction testbed task demonstrate strong performance of TractGraphCNN in two large datasets (HCP and ABCD). Graphs informed by white matter geometry demonstrate higher performance than graphs informed by gray matter connectivity. Overall, the bilateral cingulum and left middle longitudinal fasciculus are consistently highly predictive of sex. This work shows the potential of incorporating anatomical information, especially known anatomical similarities between input features, to guide convolutions in neural networks.


title: Observation of time-reversal symmetric Hall effect in graphene-WSe2 heterostructures at room temperature

abstract: In this letter, we provide experimental evidence of the time-reversal symmetric Hall effect in a mesoscopic system, namely high-mobility graphene/WSe$_2$ heterostructures. This linear, dissipative Hall effect, whose sign depends on the sign of the charge carriers, persists up to room temperature. The magnitude and the sign of the Hall signal can be tuned using an external perpendicular electric field. Our joint experimental and theoretical study establishes that the strain induced by lattice mismatch, or angle inhomogeneity, produces anisotropic bands in graphene while simultaneously breaking the inversion symmetry. The band anisotropy and reduced spatial symmetry lead to the appearance of a time-reversal symmetric Hall effect. Our study establishes graphene-transition metal dichalcogenide-based heterostructures as an excellent platform for studying the effects of broken symmetry on the physical properties of band-engineered two-dimensional systems.


title: Learning a Generic Value-Selection Heuristic Inside a Constraint Programming Solver

abstract: Constraint programming is known for being an efficient approach for solving combinatorial problems. Important design choices in a solver are the branching heuristics, which are designed to lead the search to the best solutions in a minimum amount of time. However, developing these heuristics is a time-consuming process that requires problem-specific expertise. This observation has motivated many efforts to use machine learning to automatically learn efficient heuristics without expert intervention. To the best of our knowledge, it is still an open research question. Although several generic variable-selection heuristics are available in the literature, the options for a generic value-selection heuristic are more scarce. In this paper, we propose to tackle this issue by introducing a generic learning procedure that can be used to obtain a value-selection heuristic inside a constraint programming solver. This has been achieved thanks to the combination of a deep Q-learning algorithm, a tailored reward signal, and a heterogeneous graph neural network architecture. Experiments on graph coloring, maximum independent set, and maximum cut problems show that our framework is able to find better solutions close to optimality without requiring a large amounts of backtracks while being generic.


title: Accuracy and Fidelity Comparison of Luna and DALL-E 2 Diffusion-Based Image Generation Systems

abstract: We qualitatively examine the accuracy and fidelity between two diffusion-based image generation systems, namely DALL-E 2 and Luna, which have massive differences in training datasets, algorithmic approaches, prompt resolvement, and output upscaling. The methodology used is a qualitative benchmark created by Saharia et al. and in our research we conclude that DALL-E 2 significantly edges Luna in both alignment and fidelity comparisons.


title: Sum-Rate Maximization in Active RIS-Assisted Multi-Antenna WPCN

abstract: In this paper, we propose an active reconfigurable intelligent surface (RIS) enabled hybrid relaying scheme for a multi-antenna wireless powered communication network (WPCN), where the active RIS is employed to assist both wireless energy transfer (WET) from the power station (PS) to energy-constrained users and wireless information transmission (WIT) from users to the receiving station (RS). For further performance enhancement, we propose to employ both transmit beamforming at the PS and receive beamforming at the RS. We formulate a sum-rate maximization problem by jointly optimizing the RIS phase shifts and amplitude reflection coefficients for both the WET and the WIT, transmit and receive beamforming vectors, and network resource allocation. To solve this non-convex problem, we propose an efficient alternating optimization algorithm with linear minimum mean squared error criterion, semi-definite relaxation (SDR) and successive convex approximation techniques. Specifically, the tightness of applying the SDR is proved. Simulation results demonstrate that our proposed scheme with 10 reflecting elements (REs) and 4 antennas can achieve 17.78% and 415.48% performance gains compared to the single-antenna scheme with 10 REs and passive RIS scheme with 100 REs, respectively.


title: The sharp bound of the third Hankel determinant for inverse of convex functions

abstract: The objective of this paper is to find the best possible upper bound of the third Hankel determinant for the inverse of convex functions.


title: Flying Bird Object Detection Algorithm in Surveillance Video Based on Motion Information

abstract: A Flying Bird Object Detection algorithm Based on Motion Information (FBOD-BMI) is proposed to solve the problem that the features of the object are not obvious in a single frame, and the size of the object is small (low Signal-to-Noise Ratio (SNR)) in surveillance video. Firstly, a ConvLSTM-PAN model structure is designed to capture suspicious flying bird objects, in which the Convolutional Long and Short Time Memory (ConvLSTM) network aggregated the Spatio-temporal features of the flying bird object on adjacent multi-frame before the input of the model and the Path Aggregation Network (PAN) located the suspicious flying bird objects. Then, an object tracking algorithm is used to track suspicious flying bird objects and calculate their Motion Range (MR). At the same time, the size of the MR of the suspicious flying bird object is adjusted adaptively according to its speed of movement (specifically, if the bird moves slowly, its MR will be expanded according to the speed of the bird to ensure the environmental information needed to detect the flying bird object). Adaptive Spatio-temporal Cubes (ASt-Cubes) of the flying bird objects are generated to ensure that the SNR of the flying bird objects is improved, and the necessary environmental information is retained adaptively. Finally, a LightWeight U-Shape Net (LW-USN) based on ASt-Cubes is designed to detect flying bird objects, which rejects the false detections of the suspicious flying bird objects and returns the position of the real flying bird objects. The monitoring video including the flying birds is collected in the unattended traction substation as the experimental dataset to verify the performance of the algorithm. The experimental results show that the flying bird object detection method based on motion information proposed in this paper can effectively detect the flying bird object in surveillance video.


title: Plant species richness prediction from DESIS hyperspectral data: A comparison study on feature extraction procedures and regression models

abstract: The diversity of terrestrial vascular plants plays a key role in maintaining the stability and productivity of ecosystems. Monitoring species compositional diversity across large spatial scales is challenging and time consuming. The advanced spectral and spatial specification of the recently launched DESIS (the DLR Earth Sensing Imaging Spectrometer) instrument provides a unique opportunity to test the potential for monitoring plant species diversity with spaceborne hyperspectral data. This study provides a quantitative assessment on the ability of DESIS hyperspectral data for predicting plant species richness in two different habitat types in southeast Australia. Spectral features were first extracted from the DESIS spectra, then regressed against on-ground estimates of plant species richness, with a two-fold cross validation scheme to assess the predictive performance. We tested and compared the effectiveness of Principal Component Analysis (PCA), Canonical Correlation Analysis (CCA), and Partial Least Squares analysis (PLS) for feature extraction, and Kernel Ridge Regression (KRR), Gaussian Process Regression (GPR), Random Forest Regression (RFR) for species richness prediction. The best prediction results were r=0.76 and RMSE=5.89 for the Southern Tablelands region, and r=0.68 and RMSE=5.95 for the Snowy Mountains region. Relative importance analysis for the DESIS spectral bands showed that the red-edge, red, and blue spectral regions were more important for predicting plant species richness than the green bands and the near-infrared bands beyond red-edge. We also found that the DESIS hyperspectral data performed better than Sentinel-2 multispectral data in the prediction of plant species richness. Our results provide a quantitative reference for future studies exploring the potential of spaceborne hyperspectral data for plant biodiversity mapping.


title: Scalable Communication for Multi-Agent Reinforcement Learning via Transformer-Based Email Mechanism

abstract: Communication can impressively improve cooperation in multi-agent reinforcement learning (MARL), especially for partially-observed tasks. However, existing works either broadcast the messages leading to information redundancy, or learn targeted communication by modeling all the other agents as targets, which is not scalable when the number of agents varies. In this work, to tackle the scalability problem of MARL communication for partially-observed tasks, we propose a novel framework Transformer-based Email Mechanism (TEM). The agents adopt local communication to send messages only to the ones that can be observed without modeling all the agents. Inspired by human cooperation with email forwarding, we design message chains to forward information to cooperate with the agents outside the observation range. We introduce Transformer to encode and decode the message chain to choose the next receiver selectively. Empirically, TEM outperforms the baselines on multiple cooperative MARL benchmarks. When the number of agents varies, TEM maintains superior performance without further training.


title: Double-Exponential transformation: A quick review of a Japanese tradition

abstract: This article is a short introduction to numerical methods using the double exponential (DE) transformation, such as tanh-sinh quadrature and DE-Sinc approximation. The DE-based methods for numerical computation have been developed intensively in Japan and the objective of this article is to describe the history in addition to the underlying mathematical ideas.


title: Control over Berry Curvature Dipole with Electric Field in WTe2

abstract: Berry curvature dipole plays an important role in various nonlinear quantum phenomena. However, the maximum symmetry allowed for nonzero Berry curvature dipole in the transport plane is a single mirror line, which strongly limits its effects in materials. Here, via probing the nonlinear Hall effect, we demonstrate the generation of Berry curvature dipole by applied dc electric field in WTe2, which is used to break the symmetry constraint. A linear dependence between the dipole moment of Berry curvature and the dc electric field is observed. The polarization direction of the Berry curvature is controlled by the relative orientation of the electric field and crystal axis, which can be further reversed by changing the polarity of the dc field. Our Letter provides a route to generate and control Berry curvature dipole in broad material systems and to facilitate the development of nonlinear quantum devices.


title: Open-Set Face Identification on Few-Shot Gallery by Fine-Tuning

abstract: In this paper, we focus on addressing the open-set face identification problem on a few-shot gallery by fine-tuning. The problem assumes a realistic scenario for face identification, where only a small number of face images is given for enrollment and any unknown identity must be rejected during identification. We observe that face recognition models pretrained on a large dataset and naively fine-tuned models perform poorly for this task. Motivated by this issue, we propose an effective fine-tuning scheme with classifier weight imprinting and exclusive BatchNorm layer tuning. For further improvement of rejection accuracy on unknown identities, we propose a novel matcher called Neighborhood Aware Cosine (NAC) that computes similarity based on neighborhood information. We validate the effectiveness of the proposed schemes thoroughly on large-scale face benchmarks across different convolutional neural network architectures. The source code for this project is available at: https://github.com/1ho0jin1/OSFI-by-FineTuning


title: Two-dimensional Heisenberg models with materials-dependent superexchange interactions

abstract: The two-dimensional (2D) van der Waals ferromagnetic semiconductors, such as CrI$_3$ and Cr$_2$Ge$_2$Te$_6$, and the 2D ferromagnetic metals, such as Fe$_3$GeTe$_2$ and MnSe$_2$, have been obtained in recent experiments and attracted a lot of attentions. The superexchange interaction has been suggested to dominate the magnetic interactions in these 2D magnetic systems. In the usual theoretical studies, the expression of the 2D Heisenberg models were fixed by hand due to experiences. Here, we propose a method to determine the expression of the 2D Heisenberg models by counting the possible superexchange paths with the density functional theory (DFT) and Wannier function calculations. With this method, we obtain a 2D Heisenberg model with six different nearest-neighbor exchange coupling constants for the 2D ferromagnetic metal Cr$_3$Te$_6$, which is very different for the crystal structure of Cr atoms in Cr$_3$Te$_6$. The calculated Curie temperature Tc = 328 K is close to the Tc = 344 K of 2D Cr$_3$Te$_6$ reported in recent experiment. In addition, we predict two stable 2D ferromagnetic semiconductors Cr$_3$O$_6$ and Mn$_3$O$_6$ sharing the same crystal structure of Cr$_3$Te$_6$. The similar Heisenberg models are obtained for 2D Cr$_3$O$_6$ and Mn$_3$O$_6$, where the calculated Tc is 218 K and 208 K, respectively. Our method offers a general approach to determine the expression of Heisenberg models for these 2D magnetic semiconductors and metals, and builds up a solid basis for further studies.


title: Diagonalization Games

abstract: We study several variants of a combinatorial game which is based on Cantor's diagonal argument. The game is between two players called Kronecker and Cantor. The names of the players are motivated by the known fact that Leopold Kronecker did not appreciate Georg Cantor's arguments about the infinite, and even referred to him as a "scientific charlatan". In the game Kronecker maintains a list of m binary vectors, each of length n, and Cantor's goal is to produce a new binary vector which is different from each of Kronecker's vectors, or prove that no such vector exists. Cantor does not see Kronecker's vectors but he is allowed to ask queries of the form"What is bit number j of vector number i?" What is the minimal number of queries with which Cantor can achieve his goal? How much better can Cantor do if he is allowed to pick his queries \emph{adaptively}, based on Kronecker's previous replies? The case when m=n is solved by diagonalization using n (non-adaptive) queries. We study this game more generally, and prove an optimal bound in the adaptive case and nearly tight upper and lower bounds in the non-adaptive case.


title: Selberg's central limit theorem of $L$-functions near the critical line

abstract: We find an asymptotic expansion of a multi-dimensional version of Selberg's central limit theorem for $L$-functions on $ \sigma= \frac12 + ( \log T)^{-\theta}$ and $ t \in [ T, 2T]$, where $ 0 < \theta < \frac12 $ is a constant.


title: Auditing citation polarization during the early COVID-19 pandemic

abstract: The recent pandemic stimulated scientists to publish a significant amount of research that created a surge of citations of COVID-19-related publications in a short time, leading to an abrupt inflation of the journal impact factor (IF). By auditing the complete set of COVID-19-related publications in the Web of Science, we reveal here that COVID-19-related research worsened the polarization of academic journals: the IF before the pandemic was proportional to the increment of IF, which had the effect of increasing inequality while retaining the journal rankings. We also found that the most highly cited studies related to COVID-19 were published in prestigious journals at the onset of the epidemic. Through the present quantitative investigation, our findings caution against the belief that quantitative metrics, particularly IF, can indicate the significance of individual papers. Rather, such metrics reflect the social attention given to a particular study.


title: Towards simultaneous coherent radiation in the visible and microwave bands with doped molecular crystals

abstract: Coherent sources exploiting the stimulated emission of non-equilibrium quantum systems, i.e. gain media, have proven indispensable for advancing fundamental research and engineering. The operating electromagnetic bands of such coherent sources have been continuously enriched for increasing demands.Nevertheless, for a single bench top coherent source, simultaneous generation of radiation in multiple bands, especially when the bands are widely separated, present formidable challenges with a single gain medium. Here, we propose a mechanism of simultaneously realizing the stimulated emission of radiation in the visible and microwave bands, i.e. lasing and masing actions, at ambient conditions by utilizing photoexcited singlet and triplet states of the pentacene molecules that are doped in p-terphenyl. The possibility is validated by the observed amplified spontaneous emission (ASE) at 645 nm with a narrow linewidth around 1 nm from the pentacene-doped p-terphenyl crystal used for masing at 1.45 GHz and consolidated by a 20 fold lower threshold of ASE compared to the reported masing threshold. The overall threshold of the pentacene-based multiband coherent source can be optimized by appropriate alignment of the pump-light polarization with the pentacene's transition dipole moment. Our work not only shows a great promise on immediate realization of multiband coherent sources but also establishes an intriguing solid-state platform for fundamental research of quantum optics in multiple frequency domains.


title: Event Camera Data Pre-training

abstract: This paper proposes a pre-trained neural network for handling event camera data. Our model is a self-supervised learning framework, and uses paired event camera data and natural RGB images for training. Our method contains three modules connected in a sequence: i) a family of event data augmentations, generating meaningful event images for self-supervised training; ii) a conditional masking strategy to sample informative event patches from event images, encouraging our model to capture the spatial layout of a scene and accelerating training; iii) a contrastive learning approach, enforcing the similarity of embeddings between matching event images, and between paired event and RGB images. An embedding projection loss is proposed to avoid the model collapse when enforcing the event image embedding similarities. A probability distribution alignment loss is proposed to encourage the event image to be consistent with its paired RGB image in the feature space. Transfer learning performance on downstream tasks shows the superiority of our method over state-of-the-art methods. For example, we achieve top-1 accuracy at 64.83% on the N-ImageNet dataset.


title: Two-dimensional tile displacement can simulate cellular automata

abstract: Tile displacement is a newly-recognized mechanism in DNA nanotechnology that exploits principles analogous to toehold-mediated strand displacement but within the context of self-assembled DNA origami tile arrays. Here, we formulate an abstract model of tile displacement for the simplest case: individual assemblies interacting with monomer tiles in solution. We give several constructions for programmable computation by tile displacement, from circuits to cellular automata, that vary in how they use energy (or not) to drive the system forward (or not), how much space and how many tile types they require, and whether their computational power is limited to PTIME or PSPACE with respect to the size of the system. In particular, we show that tile displacement systems are Turing universal and can simulate arbitrary two-dimensional synchronous block cellular automata, where each transition rule for updating the state of a 2 by 2 neighborhood is implemented by just a single tile.


title: Information-theoretical analysis of statistical measures for multiscale dynamics

abstract: Multiscale entropy (MSE) has been widely used to examine nonlinear systems involving multiple time scales, such as biological and economic systems. Conversely, Allan variance has been used to evaluate the stability of oscillators, such as clocks and lasers, ranging from short to long time scales. Although these two statistical measures were developed independently for different purposes in different fields in the literature, their interest is to examine multiscale temporal structures of physical phenomena under study. We show that, from an information-theoretical perspective, they share some foundations and exhibit similar tendencies. We experimentally confirmed that similar properties of the MSE and Allan variance can be observed in low-frequency fluctuations (LFF) in chaotic lasers and physiological heartbeat data. Furthermore, we calculated the condition under which this consistency between the MSE and Allan variance exists, which is related to certain conditional probabilities. Heuristically, physical systems in nature including the aforementioned LFF and heartbeat data mostly satisfy this condition, and hence the MSE and Allan variance demonstrate similar properties. As a counterexample, an artificially constructed random sequence is demonstrated, for which the MSE and Allan variance exhibit different trends.


title: Reduced Deep Convolutional Activation Features (R-DeCAF) in Histopathology Images to Improve the Classification Performance for Breast Cancer Diagnosis

abstract: Breast cancer is the second most common cancer among women worldwide. Diagnosis of breast cancer by the pathologists is a time-consuming procedure and subjective. Computer aided diagnosis frameworks are utilized to relieve pathologist workload by classifying the data automatically, in which deep convolutional neural networks (CNNs) are effective solutions. The features extracted from activation layer of pre-trained CNNs are called deep convolutional activation features (DeCAF). In this paper, we have analyzed that all DeCAF features are not necessarily led to a higher accuracy in the classification task and dimension reduction plays an important role. Therefore, different dimension reduction methods are applied to achieve an effective combination of features by capturing the essence of DeCAF features. To this purpose, we have proposed reduced deep convolutional activation features (R-DeCAF). In this framework, pre-trained CNNs such as AlexNet, VGG-16 and VGG-19 are utilized in transfer learning mode as feature extractors. DeCAF features are extracted from the first fully connected layer of the mentioned CNNs and support vector machine has been used for binary classification. Among linear and nonlinear dimensionality reduction algorithms, linear approaches such as principal component analysis (PCA) represent a better combination among deep features and lead to a higher accuracy in the classification task using small number of features considering specific amount of cumulative explained variance (CEV) of features. The proposed method is validated using experimental BreakHis dataset. Comprehensive results show improvement in the classification accuracy up to 4.3% with less computational time. Best achieved accuracy is 91.13% for 400x data with feature vector size (FVS) of 23 and CEV equals to 0.15 using pre-trained AlexNet as feature extractor and PCA as feature reduction algorithm.


title: PA-GM: Position-Aware Learning of Embedding Networks for Deep Graph Matching

abstract: Graph matching can be formalized as a combinatorial optimization problem, where there are corresponding relationships between pairs of nodes that can be represented as edges. This problem becomes challenging when there are potential ambiguities present due to nodes and edges with high similarity, and there is a need to find accurate results for similar content matching. In this paper, we introduce a novel end-to-end neural network that can map the linear assignment problem into a high-dimensional space augmented with node-level relative position information, which is crucial for improving the method's performance for similar content matching. Our model constructs the anchor set for the relative position of nodes and then aggregates the feature information of the target node and each anchor node based on a measure of relative position. It then learns the node feature representation by integrating the topological structure and the relative position information, thus realizing the linear assignment between the two graphs. To verify the effectiveness and generalizability of our method, we conduct graph matching experiments, including cross-category matching, on different real-world datasets. Comparisons with different baselines demonstrate the superiority of our method. Our source code is available under https://github.com/anonymous.


title: Online Decomposition of Surface Electromyogram into Individual Motor Unit Activities Using Progressive FastICA Peel-off

abstract: Surface electromyogram (SEMG) decomposition provides a promising tool for decoding and understanding neural drive information non-invasively. In contrast to previous SEMG decomposition methods mainly developed in offline conditions, there are few studies on online SEMG decomposition. A novel method for online decomposition of SEMG data is presented using the progressive FastICA peel-off (PFP) algorithm. The online method consists of an offline prework stage and an online decomposition stage. More specifically, a series of separation vectors are first initialized by the originally offline version of the PFP algorithm from SEMG data recorded in advance. Then they are applied to online SEMG data to extract motor unit spike trains precisely. The performance of the proposed online SEMG decomposition method was evaluated by both simulation and experimental approaches. It achieved an online decomposition accuracy of 98.53% when processing simulated SEMG data. For decomposing experimental SEMG data, the proposed online method was able to extract an average of 12.00 +- 3.46 MUs per trial, with a matching rate of 90.38% compared with results from the expert-guided offline decomposition. Our study provides a valuable way of online decomposition of SEMG data with advanced applications in movement control and health.


title: Hyperbolic and satellite Lorenz links obtained by twisting

abstract: A Lorenz link is equivalent to a T-link, which is a positive braid built by concatenating torus braids of increasing size. When each torus braid except the largest is obtained by full twists, then the T-link can be described as the Dehn filling of a parent link. In this paper, we completely classify when such parent links are hyperbolic. This gives a classification of the geometry of T-links obtained by full twists when the amount of twisting is large, although the bound on the number of required twists is not effective. We also present effective results on hyperbolicity for two families of T-links obtained by twisting, even when the number of twists is small. Finally, we identify families of satellite T-links obtained by half-twists.


title: Topic Segmentation Model Focusing on Local Context

abstract: Topic segmentation is important in understanding scientific documents since it can not only provide better readability but also facilitate downstream tasks such as information retrieval and question answering by creating appropriate sections or paragraphs. In the topic segmentation task, topic coherence is critical in predicting segmentation boundaries. Most of the existing models have tried to exploit as many contexts as possible to extract useful topic-related information. However, additional context does not always bring promising results, because the local context between sentences becomes incoherent despite more sentences being supplemented. To alleviate this issue, we propose siamese sentence embedding layers which process two input sentences independently to get appropriate amount of information without being hampered by excessive information. Also, we adopt multi-task learning techniques including Same Topic Prediction (STP), Topic Classification (TC) and Next Sentence Prediction (NSP). When these three classification layers are combined in a multi-task manner, they can make up for each other's limitations, improving performance in all three tasks. We experiment different combinations of the three layers and report how each layer affects other layers in the same combination as well as the overall segmentation performance. The model we proposed achieves the state-of-the-art result in the WikiSection dataset.


title: Clustering of large deviations in moving average processes: the long memory regime

abstract: We investigate how large deviations events cluster in the framework of an infinite moving average process with light-tailed noise and long memory. The long memory makes clusters larger, and the asymptotic behaviour of the size of the cluster turns out to be described by the first hitting time of a randomly shifted fractional Brownian motion with drift.


title: ATOMS: ALMA Three-millimeter Observations of Massive Star-forming regions -XIII. Ongoing triggered star formation within clump-fed scenario found in the massive ($\sim1500$ $\rm M_\odot$) clump

abstract: Whether ionization feedback triggers the formation of massive stars is highly debated. Using ALMA 3 mm observations with a spatial resolution of $\sim 0.05$ pc and a mass sensitivity of 1.1 $\rm M_\odot$ beam$^{-1}$ at 20 K, we investigate the star formation and gas flow structures within the ionizing feedback-driven structure, a clump-scale massive ($\gtrsim 1500$ $\rm M_\odot$) bright-rimmed cloud (BRC) associated with IRAS 18290-0924. This BRC is bound only if external compression from ionized gas is considered. A small-scale ($\lesssim1$ pc) age sequence along the direction of ionizing radiation is revealed for the embedded cores and protostars, which suggests triggered star formation via radiation-driven implosion (RDI). Furthermore, filamentary gas structures converge towards the cores located in the BRC's center, indicating that these filaments are fueling mass towards cores. The local core-scale mass infall rate derived from H$^{13}$CO$^+$ $J=1-0$ blue profile is of the same order of magnitude as the filamentary mass inflow rate, approximately 1 $\rm M_\odot$ kyr$^{-1}$. A photodissociation region (PDR) covering the irradiated clump surface is detected in several molecules, such as CCH, HCO$^+$, and CS whereas the spatial distribution stratification of these molecules is indistinct. CCH spectra of the PDR possibly indicate a photoevaporation flow leaving the clump surface with a projected velocity of $\sim2$ km s$^{-1}$. Our new observations show that RDI accompanied by a clump-fed process is operating in this massive BRC. Whether this combined process works in other massive BRCs is worth exploring with dedicated surveys.


title: Phase Transitions and Critical Phenomena for the FRW Universe in an Effective Scalar-Tensor Theory

abstract: We find phase transitions and critical phenomena of the FRW (Friedmann-Robertson-Walker) universe in the framework of an effective scalar-tensor theory that belongs to the Horndeski class. We identify the thermodynamic pressure (generalized force) $P$ of the FRW universe in this theory with the work density $W$ of the perfect fluid, which is a natural definition directly read out from the first law of thermodynamics. We derive the thermodynamic equation of state $P=P(V, T)$ for the FRW universe in this theory and make a thorough discussion of its $P$-$V$ phase transitions and critical phenomena. We calculate the critical exponents, and show that they are the same with the mean field theory, and thus obey the scaling laws.


title: Thomsen-type parameters and attenuation coefficients for constant-Q transverse isotropy

abstract: Transversely isotropic (TI) media with the frequency-independent quality-factor elements (also called ``constant-$Q$'' transverse isotropy) are often used to describe attenuation anisotropy in sedimentary rocks. The attenuation coefficients in constant-$Q$ TI models can be conveniently defined in terms of the Thomsen-type attenuation-anisotropy parameters. Recent research indicates that not all those parameters for such constant-$Q$ media are frequency-independent. Here, we present concise analytic formulae for the Thomsen-type attenuation parameters for Kjartansson's constant-$Q$ TI model and show that one of them ($\delta_{Q}$) varies with frequency. The analytic expression for $\delta_{Q}$ helps evaluate the frequency dependence of the normalized attenuation coefficients of P- and SV-waves by introducing the newly defined ``dispersion factors''. Viscoacoustic constant-$Q$ transverse isotropy is also discussed as a special case, for which the elliptical condition and simplified expressions for the parameters $\delta$ and $\delta_{Q}$ are derived. Our results show that in the presence of significant absorption the attenuation coefficients of the ``constant-$Q$'' model vary with frequency for oblique propagation with respect to the symmetry axis. This variation needs to be taken into account when applying the spectral-ratio method and other attenuation-analysis techniques.


title: Enabling Augmented Segmentation and Registration in Ultrasound-Guided Spinal Surgery via Realistic Ultrasound Synthesis from Diagnostic CT Volume

abstract: This paper aims to tackle the issues on unavailable or insufficient clinical US data and meaningful annotation to enable bone segmentation and registration for US-guided spinal surgery. While the US is not a standard paradigm for spinal surgery, the scarcity of intra-operative clinical US data is an insurmountable bottleneck in training a neural network. Moreover, due to the characteristics of US imaging, it is difficult to clearly annotate bone surfaces which causes the trained neural network missing its attention to the details. Hence, we propose an In silico bone US simulation framework that synthesizes realistic US images from diagnostic CT volume. Afterward, using these simulated bone US we train a lightweight vision transformer model that can achieve accurate and on-the-fly bone segmentation for spinal sonography. In the validation experiments, the realistic US simulation was conducted by deriving from diagnostic spinal CT volume to facilitate a radiation-free US-guided pedicle screw placement procedure. When it is employed for training bone segmentation task, the Chamfer distance achieves 0.599mm; when it is applied for CT-US registration, the associated bone segmentation accuracy achieves 0.93 in Dice, and the registration accuracy based on the segmented point cloud is 0.13~3.37mm in a complication-free manner. While bone US images exhibit strong echoes at the medium interface, it may enable the model indistinguishable between thin interfaces and bone surfaces by simply relying on small neighborhood information. To overcome these shortcomings, we propose to utilize a Long-range Contrast Learning Module to fully explore the Long-range Contrast between the candidates and their surrounding pixels.


title: Evolution and explosions of metal enriched supermassive stars: proton rich general relativistic instability supernovae

abstract: The assembly of supermassive black holes poses a challenge primarily because of observed quasars at high redshift, but additionally because of the current lack of observations of intermediate mass black holes. One plausible scenario for creating supermassive black holes is direct collapse triggered by the merger of two gas rich galaxies. This scenario allows the creation of supermassive stars with solar metallicity, where the enhanced metallicity is enabled by extremely rapid accretion. We investigate the behavior of metal enriched supermassive stars which collapse due to the general relativistic radial instability during hydrogen burning. These stars contain both hydrogen and metals and thus may explode due to the CNO cycle (carbon-nitrogen-oxygen) and the rp process (rapid proton capture). We perform a suite of stellar evolution simulations for a range of masses and metallicities, both including and neglecting mass loss. We evaluate the stability of these supermassive stars by solving the pulsation equation in general relativity. When the stars becomes unstable, we perform 1D general relativistic hydrodynamical simulations coupled to a 153 isotope nuclear network with cooling from neutrino reactions, in order to determine if the stars explode. If the stars do explode, we post process the nucleosynthesis using a 514 isotope network which includes additional proton rich isotopes. These explosions are characterized by enhanced nitrogen and intermediate mass elements ($16\geq\rm{A}\geq25$), and suppressed light elements ($8\geq\rm{A}\geq14$), and we comment on recent observations of super-solar nitrogen in GN-z11.


title: Compact and scalable polarimetric self-coherent receiver using dielectric metasurface

abstract: The polarimetric self-coherent system using a direct-detection-based Stokes-vector receiver (SVR) is a promising technology to meet both the cost and capacity requirements of the short-reach optical interconnects. However, conventional SVRs require a number of optical components to detect the state of polarization at high speed, resulting in substantially more complicated receiver configurations compared with the current intensity-modulation-direct-detection (IMDD) counterparts. Here, we demonstrate a simple and compact polarimetric self-coherent receiver based on a thin dielectric metasurface and a photodetector array (PDA). With a single 1.05-$\mu$m-thick metasurface device fabricated on a compact silicon-on-quartz chip, we implement functionalities of all the necessary passive components: a 1$\times$3 splitter, three polarization beam splitters with different polarization bases, and six focusing lenses. Combined with a high-speed PDA, we demonstrate self-coherent transmission of 20-GBd 16-ary quadrature amplitude modulation (16QAM) and 50-GBd quadrature phase-shift keying (QPSK) signals over a 25-km single-mode fiber. Owing to the surface-normal configuration, it can easily be scaled to receive spatially multiplexed channels from a multicore fiber or a fiber bundle, enabling compact and low-cost receiver modules for the future highly parallelized self-coherent systems.


title: UOCS-IX. AstroSat/UVIT study of the open cluster NGC 2818: Blue Stragglers, Yellow Stragglers, Planetary Nebula, and their membership

abstract: We present the first far-UV (FUV) imaging results of the intermediate-age Galactic open cluster NGC 2818 that has a Planetary nebula (PN) within the field using images taken from the Ultra-violet Imaging Telescope (UVIT) aboard AstroSat. We identify cluster members by combining UVIT-detected sources with Gaia EDR3 data. We detect four bright and hot blue straggler stars (BSSs) and two yellow straggler stars (YSSs) based on their location in the optical and FUV-optical color-magnitude diagrams. Based on the parameters estimated using Spectral Energy Distribution (SED), we infer that BSSs are either collisional products or might have undetectable white dwarf (WD) companions. Our photometric analysis of YSSs confirms their binarity, consistent with the spectroscopic results. We find YSSs to be formed through a mass-transfer scenario and the hot components are likely to be A-type subdwarfs. A comparison of the radial velocity (RV), Gaia EDR3 proper motion of the PN with the cluster, and reddening towards the PN and the cluster does not rule out the membership of the PN. Comparing the central star's position with theoretical pAGB models suggest that it has already entered the WD cooling phase, and its mass is deduced to be ~0.66Msun. The corresponding progenitor mass turns out to be ~2.1Msun, comparable to the turn-off mass of the cluster, implying that the progenitor could have formed in the cluster. We suggest that the NGC 2818 might be one of the few known clusters to host a PN, providing a unique opportunity to test stellar evolution models.


title: Study of variability in long-term multiwavelength optical lightcurves of blazar AO 0235+164

abstract: We present a long-term and intraday variability study on optical multiwaveband ($U\!BV\!RI$) data from the blazar AO 0235+164 collected by various telescopes for $\sim$44 years (1975--2019). The blazar was found to be significantly variable over the years in all wavebands with a variation of about six magnitudes between its low and active states. The variations in the different wavebands are highly correlated without any time lag. We did not observe any significant trend in color variation with time, but we observed a bluer-when-brighter trend between the $B-I$ color index and the $R$-magnitude. Optical $BV\!R$-band spectral energy distributions always show a convex shape. Significant intraday variability was frequently seen in the quasi-simultaneous observations of AO\,0235+164 made on 22 nights in $R$ and $V$-bands by the CASLEO and CAHA telescopes during 1999--2019. We also estimated the central supermassive black-hole mass of $7.9\times10^7 M_{\odot}$ by analyzing the broad Mg II emission line in AO 0235+164's spectrum. We briefly explore the probable physical scenarios responsible for the observed variability.


title: Optimizing density-functional simulations for two-dimensional metals

abstract: Unlike covalent two-dimensional (2D) materials like graphene, 2D metals have non-layered structures due to their non-directional, metallic bonding. While experiments on 2D metals are still scarce and challenging, density-functional theory (DFT) provides an ideal approach to predict their basic properties and assist in their design. However, DFT methods have been rarely benchmarked against metallic bonding at low dimensions. Therefore, to identify optimal DFT attributes for a desired accuracy, we systematically benchmark exchange-correlation functionals from LDA to hybrids and basis sets from plane waves to local basis with different pseudopotentials. With 1D chain, 2D honeycomb, 2D square, 2D hexagonal, and 3D bulk metallic systems, we compare the DFT attributes using bond lengths, cohesive energies, elastic constants, densities of states, and computational costs. Although today most DFT studies on 2D metals use plane waves, our comparisons reveal that local basis with often-used PBE exchange-correlation is well sufficient for most purposes, while plane waves and hybrid functionals bring limited improvement compared to the greatly increased computational cost. These results ease the demands for generating DFT data for better interaction with experiments and for data-driven discoveries of 2D metals incorporating machine learning algorithms.


title: EPR-Net: Constructing non-equilibrium potential landscape via a variational force projection formulation

abstract: We present EPR-Net, a novel and effective deep learning approach that tackles a crucial challenge in biophysics: constructing potential landscapes for high-dimensional non-equilibrium steady-state (NESS) systems. EPR-Net leverages a nice mathematical fact that the desired negative potential gradient is simply the orthogonal projection of the driving force of the underlying dynamics in a weighted inner-product space. Remarkably, our loss function has an intimate connection with the steady entropy production rate (EPR), enabling simultaneous landscape construction and EPR estimation. We introduce an enhanced learning strategy for systems with small noise, and extend our framework to include dimensionality reduction and state-dependent diffusion coefficient case in a unified fashion. Comparative evaluations on benchmark problems demonstrate the superior accuracy, effectiveness, and robustness of EPR-Net compared to existing methods. We apply our approach to challenging biophysical problems, such as an 8D limit cycle and a 52D multi-stability problem, which provide accurate solutions and interesting insights on constructed landscapes. With its versatility and power, EPR-Net offers a promising solution for diverse landscape construction problems in biophysics.

categories: physics.bio-ph cond-mat.stat-mech cs.AI physics.comp-ph


title: StitchNet: Composing Neural Networks from Pre-Trained Fragments

abstract: We propose StitchNet, a novel neural network creation paradigm that stitches together fragments (one or more consecutive network layers) from multiple pre-trained neural networks. StitchNet allows the creation of high-performing neural networks without the large compute and data requirements needed under traditional model creation processes via backpropagation training. We leverage Centered Kernel Alignment (CKA) as a compatibility measure to efficiently guide the selection of these fragments in composing a network for a given task tailored to specific accuracy needs and computing resource constraints. We then show that these fragments can be stitched together to create neural networks with accuracy comparable to that of traditionally trained networks at a fraction of computing resource and data requirements. Finally, we explore a novel on-the-fly personalized model creation and inference application enabled by this new paradigm. The code is available at https://github.com/steerapi/stitchnet.


title: Random forests, sound symbolism and Pokemon evolution

abstract: This study constructs machine learning algorithms that are trained to classify samples using sound symbolism, and then it reports on an experiment designed to measure their understanding against human participants. Random forests are trained using the names of Pokemon, which are fictional video game characters, and their evolutionary status. Pokemon undergo evolution when certain in-game conditions are met. Evolution changes the appearance, abilities, and names of Pokemon. In the first experiment, we train three random forests using the sounds that make up the names of Japanese, Chinese, and Korean Pokemon to classify Pokemon into pre-evolution and post-evolution categories. We then train a fourth random forest using the results of an elicitation experiment whereby Japanese participants named previously unseen Pokemon. In Experiment 2, we reproduce those random forests with name length as a feature and compare the performance of the random forests against humans in a classification experiment whereby Japanese participants classified the names elicited in Experiment 1 into pre-and post-evolution categories. Experiment 2 reveals an issue pertaining to overfitting in Experiment 1 which we resolve using a novel cross-validation method. The results show that the random forests are efficient learners of systematic sound-meaning correspondence patterns and can classify samples with greater accuracy than the human participants.


title: SPRING: Situated Conversation Agent Pretrained with Multimodal Questions from Incremental Layout Graph

abstract: Existing multimodal conversation agents have shown impressive abilities to locate absolute positions or retrieve attributes in simple scenarios, but they fail to perform well when complex relative positions and information alignments are involved, which poses a bottleneck in response quality. In this paper, we propose a Situated Conversation Agent Petrained with Multimodal Questions from INcremental Layout Graph (SPRING) with abilities of reasoning multi-hops spatial relations and connecting them with visual attributes in crowded situated scenarios. Specifically, we design two types of Multimodal Question Answering (MQA) tasks to pretrain the agent. All QA pairs utilized during pretraining are generated from novel Incremental Layout Graphs (ILG). QA pair difficulty labels automatically annotated by ILG are used to promote MQA-based Curriculum Learning. Experimental results verify the SPRING's effectiveness, showing that it significantly outperforms state-of-the-art approaches on both SIMMC 1.0 and SIMMC 2.0 datasets.


title: Collective coordinates method in relativistic theory

abstract: A field theoretical perturbation theory in inverse powers of coupling constant is developed which is manifestly covariant in every order of the expansion. A dilatation operator serves as an evolution dynamical one in a scale non-invariant theory.


title: Ab initio descriptions of $A=16$ mirror nuclei with resonance and continuum coupling

abstract: We have used an {\it ab initio} Gamow shell model to study the isospin symmetry breaking in the $A=16$ mirror nuclei of $^{16}$F, $^{16}$N, $^{16}$Ne and $^{16}$C. Starting from a chiral interaction with two-nucleon force (2NF) at N$^3$LO and three-nucleon force (3NF) at N$^2$LO, a complex-momentum ${\it psd}$-shell Hamiltonian was constructed by employing the many-body perturbation theory in the Gamow Hartree-Fock basis which includes bound, resonant and continuum states self-consistently. Such an elaborated {\it ab initio} Gamow shell model with both continuum coupling and 3NF included can properly treat the many-body correlations of weakly bound and unbound nuclei. The mirror partners of $^{16}$F and $^{16}$N exhibit different level orders in their excitation spectra, which can be well explained by the inclusion of 3NF in the calculation. The isospin asymmetry between the mirror partners $^{16}$Ne and $^{16}$C was studied in detail by insight into their configuration structures. The interplay between 3NF and the continuum coupling is discussed in the weakly bound and unbound nuclear states.


title: Quantum Bayesian Inference in Quasiprobability Representations

abstract: Bayes' rule plays a crucial piece of logical inference in information and physical sciences alike. Its extension into the quantum regime has been the object of several recent works. These quantum versions of Bayes' rule have been expressed in the language of Hilbert spaces. In this paper, we derive the expression of the Petz recovery map within any quasiprobability representation, with explicit formulas for the two canonical choices of normal quasiprobability representations (which include Discrete Wigner representations) and of representations based on symmetric, informationally complete positive operator-valued measures (SIC-POVMs). By using the same mathematical syntax of (quasi-)stochastic matrices acting on (quasi-)stochastic vectors, the core difference in logical inference between classical and quantum theory is found in the manipulation of the reference prior rather than in the representation of the channel.


title: Learning Trajectory-Word Alignments for Video-Language Tasks

abstract: In a video, an object usually appears as the trajectory, i.e., it spans over a few spatial but longer temporal patches, that contains abundant spatiotemporal contexts. However, modern Video-Language BERTs (VDL-BERTs) neglect this trajectory characteristic that they usually follow image-language BERTs (IL-BERTs) to deploy the patch-to-word (P2W) attention that may over-exploit trivial spatial contexts and neglect significant temporal contexts. To amend this, we propose a novel TW-BERT to learn Trajectory-Word alignment by a newly designed trajectory-to-word (T2W) attention for solving video-language tasks. Moreover, previous VDL-BERTs usually uniformly sample a few frames into the model while different trajectories have diverse graininess, i.e., some trajectories span longer frames and some span shorter, and using a few frames will lose certain useful temporal contexts. However, simply sampling more frames will also make pre-training infeasible due to the largely increased training burdens. To alleviate the problem, during the fine-tuning stage, we insert a novel Hierarchical Frame-Selector (HFS) module into the video encoder. HFS gradually selects the suitable frames conditioned on the text context for the later cross-modal encoder to learn better trajectory-word alignments. By the proposed T2W attention and HFS, our TW-BERT achieves SOTA performances on text-to-video retrieval tasks, and comparable performances on video question-answering tasks with some VDL-BERTs trained on much more data. The code will be available in the supplementary material.


title: Corrupted by Algorithms? How AI-generated and Human-written Advice Shape (Dis)honesty

abstract: Artificial Intelligence (AI) increasingly becomes an indispensable advisor. New ethical concerns arise if AI persuades people to behave dishonestly. In an experiment, we study how AI advice (generated by a Natural-Language-Processing algorithm) affects (dis)honesty, compare it to equivalent human advice, and test whether transparency about advice source matters. We find that dishonesty-promoting advice increases dishonesty, whereas honesty-promoting advice does not increase honesty. This is the case for both AI- and human advice. Algorithmic transparency, a commonly proposed policy to mitigate AI risks, does not affect behaviour. The findings mark the first steps towards managing AI advice responsibly.


title: Adaptively Clustering Neighbor Elements for Image-Text Generation

abstract: We propose a novel Transformer-based image-to-text generation model termed as \textbf{ACF} that adaptively clusters vision patches into object regions and language words into phrases to implicitly learn object-phrase alignments for better visual-text coherence. To achieve this, we design a novel self-attention layer that applies self-attention over the elements in a local cluster window instead of the whole sequence. The window size is softly decided by a clustering matrix that is calculated by the current input data and thus this process is adaptive. By stacking these revised self-attention layers to construct ACF, the small clusters in the lower layers can be grouped into a bigger cluster, \eg vision/language. ACF clusters small objects/phrases into bigger ones. In this gradual clustering process, a parsing tree is generated which embeds the hierarchical knowledge of the input sequence. As a result, by using ACF to build the vision encoder and language decoder, the hierarchical object-phrase alignments are embedded and then transferred from vision to language domains in two popular image-to-text tasks: Image captioning and Visual Question Answering. The experiment results demonstrate the effectiveness of ACF, which outperforms most SOTA captioning and VQA models and achieves comparable scores compared with some large-scale pre-trained models. Our code is available \href{https://github.com/ZihuaEvan/ACFModel/}{[here]}.


title: High-level semantic feature matters few-shot unsupervised domain adaptation

abstract: In few-shot unsupervised domain adaptation (FS-UDA), most existing methods followed the few-shot learning (FSL) methods to leverage the low-level local features (learned from conventional convolutional models, e.g., ResNet) for classification. However, the goal of FS-UDA and FSL are relevant yet distinct, since FS-UDA aims to classify the samples in target domain rather than source domain. We found that the local features are insufficient to FS-UDA, which could introduce noise or bias against classification, and not be used to effectively align the domains. To address the above issues, we aim to refine the local features to be more discriminative and relevant to classification. Thus, we propose a novel task-specific semantic feature learning method (TSECS) for FS-UDA. TSECS learns high-level semantic features for image-to-class similarity measurement. Based on the high-level features, we design a cross-domain self-training strategy to leverage the few labeled samples in source domain to build the classifier in target domain. In addition, we minimize the KL divergence of the high-level feature distributions between source and target domains to shorten the distance of the samples between the two domains. Extensive experiments on DomainNet show that the proposed method significantly outperforms SOTA methods in FS-UDA by a large margin (i.e., 10%).